Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Assume that we are training a multivariate linear regression model using three instances as follows. instance id: , ( x 1 , x 2 )

Assume that we are training a multivariate linear regression model using three instances as follows.
instance id: ,(x1,x2), label y
instance 1:
instance 2: (-0.5,1),1
instance 3: (2,0.5),1
The cost function is based on mean squared error as follows.
min0,1,216i=13(h(x(i))-y(i))2.
Assume that we have initialized
w=[0,1,2]=[0,0.5,1].
You apply gradient descent algorithm to compute a w that minimizes the cost function w.r.t. the three
given instances. Assume that in the first iteration, we set learning rate =0.8. In the second iteration,
we set learning rate =0.4. Please concisely show how w is updated in the first and second iterations.
image text in transcribed

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Data Infrastructure For Medical Research In Databases

Authors: Thomas Heinis ,Anastasia Ailamaki

1st Edition

1680833480, 978-1680833485

More Books

Students also viewed these Databases questions