Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

1. Consider a noisy target y wx+e for generating the data, where e is a noise term with zero mean and 2 variance, independently generated

image text in transcribed

1. Consider a noisy target y wx+e for generating the data, where e is a noise term with zero mean and 2 variance, independently generated for every example (x,y). The expected error of the best possible linear fit to this target is thus 2. For the data D{(Xyy1), , (XN-JN), denote the noise n yn as en and lete = [1,2, . . . ,ENI", assume that XTX is invertible. By following the steps below, show that the expected in-sample error of linear regression with respect to D is given by d 1 (a) Show that the in-sample estimate of y is given by Xw't He. (H was defined in the exercise two of Homework 6) (b) Show that the in-sample error vector y-y can be expressed by a matrix times e. What is the matrix? (c) Express Ein (Wlin) in terms of e using (b), and simplify the expression using (c) of exercise two of Homework 6. 1. Consider a noisy target y wx+e for generating the data, where e is a noise term with zero mean and 2 variance, independently generated for every example (x,y). The expected error of the best possible linear fit to this target is thus 2. For the data D{(Xyy1), , (XN-JN), denote the noise n yn as en and lete = [1,2, . . . ,ENI", assume that XTX is invertible. By following the steps below, show that the expected in-sample error of linear regression with respect to D is given by d 1 (a) Show that the in-sample estimate of y is given by Xw't He. (H was defined in the exercise two of Homework 6) (b) Show that the in-sample error vector y-y can be expressed by a matrix times e. What is the matrix? (c) Express Ein (Wlin) in terms of e using (b), and simplify the expression using (c) of exercise two of Homework 6

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Students also viewed these Databases questions

Question

nearest cent. $

Answered: 1 week ago

Question

8. Explain the relationship between communication and context.

Answered: 1 week ago

Question

d. How were you expected to contribute to family life?

Answered: 1 week ago