Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

My vector multiplication skills have gotten very rusty. I think that the equation 1 shown is wrong, given that the part highlighted in red seems

My vector multiplication skills have gotten very rusty. I think that the equation 1 shown is wrong, given that the part highlighted in red seems to imply that X==w. I would like to know if the gradient that I wrote down is correct and why. Also, if the circled part is correct, then wouldn't I just have to multiply by X^T * X again to derive equation 1?

image text in transcribed
We have learned how to solve linear regression numerically using gradient descent. This homework problem will help you to understand how to solve for regression parameters in closed-form. (a) (5 points) Linear regression minimizes the squared error SJ( w) min- _(yi - yi)?, Swu = 2 X Xw - 24 X ASK where y = Xw is the prediction. In vectorized form and assuming a linear model the ABOUT cost function is given by J ( w) = =(Xu - Y)I (Xw - Y). THIS To find the parameters w that minimize the objective J(w), we take the derivative of J(w) with respect to w and set it to 0, specifically, VuJ(w) = =(2XTXw - 2YTW) = 0. (1) Name: Rewriting Eq. (1), 2XTXw = 2YTX. Thus, w = (XX)-lyTx. Please derive Eq. (1). Your

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image_2

Step: 3

blur-text-image_3

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Transportation A Global Supply Chain Perspective

Authors: John J. Coyle, Robert A. Novak, Brian Gibson, Edward J. Bard

8th edition

9781305445352, 1133592961, 130544535X, 978-1133592969

More Books

Students also viewed these Mathematics questions

Question

importance of the HTTP protocol

Answered: 1 week ago