Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Someone please please please help me answer part d of the question, please I need it urgently! Thank you! (ONLY PART D) 3 Linear Regression
Someone please please please help me answer part d of the question, please I need it urgently! Thank you! (ONLY PART D)
3 Linear Regression [2 pts] A closed form solution (normal equation) for linear regression problem is as follows: 0 = (XTX)-1XTY. A probabilistic interpretation of linear regression tells us that we are relying on an assumption that each data point is actually sampled from a linear hyperplane, with some noise. The noise follows a zero-mean Gaussian distribution with constant variance. Specifically, Y' = 07 xi+ E (2) 2where el ~ N(0, 021), 0 E Rd, and {X', Y' } is the i-th data point. In other words, we are assuming that each point is independent to each other and that every data point has the same variance. (a) Using the normal equation, and the model (Eqn. 2), derive the expectation E[0]. Note that here X is fixed, and only Y is random, i.e. "fixed design" as in statistics. [0.4 pts] (b) Similarly, derive the variance Var. [0.4 pts] (c) Under the white noise assumption above, someone claims that 0 follows Gaussian distribu- tion with mean and variance in (a) and (b), respectively. Do you agree with this claim? Why or why not? [0.5 pts](d) Weighted linear regression Suppose we keep the independence assumption but remove the same variance assumption. In other words, data points would be still sampled independently, but now they may have different variance of. Thus, the covariance matrix of Y would be still diagonal, but with different values: E = (3) 0 Derive the estimator 0 (similar to the normal equations) for this problem using matrix-vector notations with E. [0.7 pts]Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started