Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Please also explanation . Exercise 3.1 We have three observed points (23,41), (67,84), (78, 100). Question: fit them to a linear model: Y = Bo

image text in transcribed

Please also explanation .

Exercise 3.1 We have three observed points (23,41), (67,84), (78, 100). Question: fit them to a linear model: Y = Bo + B1X. For the ease of computation, we use residual sum of squares (RSS) as the loss function to estimate the parameters: RSS = (4 f(x:)) Set the learning rate 1 = 0.00001, the initial guess for the parameters: Bo = 7, B1 = 1. You only need to provide the first three iterations using Gradient Descent. Hint: 1) Compose the loss function based on the RSS formula 2) Take the partial derivative of RSS function 3) Substitute the initialized parameters to check the RSS Iteration 1: a) Plug Bo = 7,B2 = 1 into the partial derivative equations for RSS b) Compute the step size, use the provided learning rate c) Update the parameters (check the lecture slides for the equation) d) Re-compute the RSS to check the loss change Repeat Iteration 1 for another 2 iterations to see the change in trend and loss Exercise 3.1 We have three observed points (23,41), (67,84), (78, 100). Question: fit them to a linear model: Y = Bo + B1X. For the ease of computation, we use residual sum of squares (RSS) as the loss function to estimate the parameters: RSS = (4 f(x:)) Set the learning rate 1 = 0.00001, the initial guess for the parameters: Bo = 7, B1 = 1. You only need to provide the first three iterations using Gradient Descent. Hint: 1) Compose the loss function based on the RSS formula 2) Take the partial derivative of RSS function 3) Substitute the initialized parameters to check the RSS Iteration 1: a) Plug Bo = 7,B2 = 1 into the partial derivative equations for RSS b) Compute the step size, use the provided learning rate c) Update the parameters (check the lecture slides for the equation) d) Re-compute the RSS to check the loss change Repeat Iteration 1 for another 2 iterations to see the change in trend and loss

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Visual Basic 4 Ole Database And Controls Superbible

Authors: Michael Hatmaker, C. Woody Butler, Ibrahim Malluf, Bill Potter

1st Edition

1571690077, 978-1571690074

More Books

Students also viewed these Databases questions