Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Consider an error function (W - 3) (w -4) (w-3) (w - 4) 4 + 9 6 . Different variants of gradient descent algorithm

Consider an error function (w - 3) (w -4) (w-3) (w - 4) 4 + 9 6 . Different variants of gradient descent

Consider an error function (W - 3) (w -4) (w-3) (w - 4) 4 + 9 6 . Different variants of gradient descent algorithm can be used to minimize this error function w.r.t (w, W2). Assume (w, W) = (1, 1) at time (t-1) and after update (w, W2) = (1.5, 2.0) at time (t). Assume a = 1.5, B =0.6, n = 0.3. 1. E(W, W) = 0.05 + Compute the value that minimizes (w1 , w2). Compute the minimum possible value of error. 2. What will be value of (w1, w2 ) at time (t + 1) if standard gradient descent is used? 3. What will be value of (w1, w2 ) at time (t + 1) if momentum is used? 4. What will be value of (w1, w2 ) at time (t + 1) if RMSPRop is used? 5. What will be value of (w1, w2 ) at time (t + 1) if Adam is used?

Step by Step Solution

3.45 Rating (155 Votes )

There are 3 Steps involved in it

Step: 1

To find the minimum set the partial derivatives of E w w with respect to w and w to zero and s... blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Introduction to Algorithms

Authors: Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest

3rd edition

978-0262033848

More Books

Students also viewed these Programming questions

Question

What is the formula to calculate the mth Fibonacci number?

Answered: 1 week ago

Question

Assess the security of an online profile

Answered: 1 week ago

Question

Show that the solution of T(n) = T(n=2) + 1 is O(lg n).

Answered: 1 week ago