Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Someone please please please help me answer part d of the question, please I need it urgently! Thank you! (ONLY PART D) 3 Linear Regression

image text in transcribedimage text in transcribed

Someone please please please help me answer part d of the question, please I need it urgently! Thank you! (ONLY PART D)

image text in transcribedimage text in transcribedimage text in transcribed
3 Linear Regression [2 pts] A closed form solution (normal equation) for linear regression problem is as follows: 0 = (XTX)-1XTY. A probabilistic interpretation of linear regression tells us that we are relying on an assumption that each data point is actually sampled from a linear hyperplane, with some noise. The noise follows a zero-mean Gaussian distribution with constant variance. Specifically, Y' = 07 xi+ E (2) 2where el ~ N(0, 021), 0 E Rd, and {X', Y' } is the i-th data point. In other words, we are assuming that each point is independent to each other and that every data point has the same variance. (a) Using the normal equation, and the model (Eqn. 2), derive the expectation E[0]. Note that here X is fixed, and only Y is random, i.e. "fixed design" as in statistics. [0.4 pts] (b) Similarly, derive the variance Var. [0.4 pts] (c) Under the white noise assumption above, someone claims that 0 follows Gaussian distribu- tion with mean and variance in (a) and (b), respectively. Do you agree with this claim? Why or why not? [0.5 pts](d) Weighted linear regression Suppose we keep the independence assumption but remove the same variance assumption. In other words, data points would be still sampled independently, but now they may have different variance of. Thus, the covariance matrix of Y would be still diagonal, but with different values: E = (3) 0 Derive the estimator 0 (similar to the normal equations) for this problem using matrix-vector notations with E. [0.7 pts]

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Measure Theory And Integration

Authors: M M Rao, MM Rao

2nd Edition

1351991485, 9781351991483

More Books

Students also viewed these Mathematics questions

Question

Compare the EITC with the minimum wage.

Answered: 1 week ago

Question

2. It is the results achieved that are important.

Answered: 1 week ago