Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Need help with this homework question for my Stats Data Science class! We code in python on Jupyterhub, but I don't mind, as long as

Need help with this homework question for my Stats Data Science class! We code in python on Jupyterhub, but I don't mind, as long as it's coded in python it's fine!

image text in transcribed
Points out of 20.00 Suppose we have ?2 observations of (yi, Ti, Ti2), where r, E RS. The data matrix is of size X E Rx2 and y/ is a column vector. The parameter of interest is 0 = (01 02)". Flag question Given X" , y and ) as inputs, ridge regression computes @ that minimizes the following optimization problem: minimize, f (@) where f(0) = ally - Xol12 + 11013. The 2-norm of a column vector of length k is |lull; = ulu = >!_, up. Part 1 Express f(01, 02) as a sum over fi(61, (2), where i = 1, 2, ..., n. Your expression should look like f(01, 02) = zn EF fi(01, 02). Write out the **complete expression** for f($1, #2). Part 2 Calculate partial derivatives of f (01, 02) respect to 01 and 02: 20, f (0 1, 02) = ... 202 f (01, 02) = ... Part 3 Given an appropriate step length a > 0, derive the updates for current estimates 0, and 02: gnew = 01 + a . ... gnew = 02 + 0 . ... Part 4 Combine the updates given by the previous part into a matrix update. Write your answer in terms of updated parameter vector gnew, current estimate @ , vector y, matrix X" , and other constants (a, n, and ) )

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Differential Equations For Engineers

Authors: Wei Chau Xie

1st Edition

0511771037, 9780511771033

More Books

Students also viewed these Mathematics questions

Question

What is the background of the situation?

Answered: 1 week ago