Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Q1. Consider fitting the simple model y = 3x-, to some data points (T1, y1), . .. , (In, yn). By minimizing the RSS show

image text in transcribed
Q1. Consider fitting the simple model y = 3x-, to some data points (T1, y1), . .. , (In, yn). By minimizing the RSS show that the optimal choice of B is B = Linyi (1) (a) Now consider a Ridge regression problem which requires minimizing RSS Ridge = (yi - Ba?)2 + 282. 1= 1 Show that in this case the optimal selection of B is BR = (2) (b) If the true regression function is in the form of f(x) = Bx2 and we measure the noisy observations y = Br' + 6, where e is a random variable with Ec = 0, var(() = o', show that var(BR) = - (c) By setting A = 0 we can immediately see that for the optimal value of B in (1), var() can be calculated as 02 var(B) = show (mathematically or discuss technically) that for all > > 0: var(BR)

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Complex Geometry And Dynamics The Abel Symposium 2013

Authors: John Erik Fornaess, Marius Irgens, Erlend Fornaess Wold

1st Edition

3319203371, 9783319203379

More Books

Students also viewed these Mathematics questions