Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

solve part B only 3. Gradient depends on inner product. Therefore, one variant of gradient descent is obtained by choosing a weighted inner product of

solve part B only

image text in transcribed
3. Gradient depends on inner product. Therefore, one variant of gradient descent is obtained by choosing a weighted inner product of R" rather than the standard one. In particular, given a symmetric positive definite matrix W e Roxn, we know that (x, y)w :=x Wy defines an inner product of R". (a) Express Vwf (the gradient of f in R" with the weighted inner product (, .)w ) in terms of W and Vf (the gradient of f in R" with the standard inner product). (b) Give the gradient descent algorithm for solving (1) under the weighted inner product (, .)w (i.e., find an explicit formula of a(*+1) when we replace (., .) and | . |? in (2) by (, .)w and I| . Ili respectively). (By choosing a suitable W, we may obtain faster algorithms than the standard gradient descent. This technique is known as preconditioning.)

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image_2

Step: 3

blur-text-image_3

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Probability and Random Processes With Applications to Signal Processing and Communications

Authors: Scott Miller, Donald Childers

2nd edition

123869811, 978-0121726515, 121726517, 978-0130200716, 978-0123869814

More Books

Students also viewed these Mathematics questions