Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Can you please please please answer part d of this question in details with explanation (Thank you!) 3 Linear Regression [2 pts] A closed form
Can you please please please answer part d of this question in details with explanation (Thank you!)
3 Linear Regression [2 pts] A closed form solution (normal equation) for linear regression problem is as follows: e = (XX)-1XTY. A probabilistic interpretation of linear regression tells us that we are relying on an assumption that each data point is actually sampled from a linear hyperplane, with some noise. The noise follows a zero-mean Gaussian distribution with constant variance. Specifically, Y = oxite (2) 2 where e" ~ N(0, o'[), 0 ER, and {X", Y'} is the i-th data point. In other words, we are assuming that each point is independent to each other and that every data point has the same variance. (a) Using the normal equation, and the model (Eqn. 2), derive the expectation E[0]. Note that here X is fixed, and only Y is random, i.e. "fixed design" as in statistics. [0.4 pts] (b) Similarly, derive the variance Var. [0.4 pts] (c) Under the white noise assumption above, someone claims that o follows Gaussian distribu- tion with mean and variance in (a) and (b), respectively. Do you agree with this claim? Why or why not? [0.5 pts] 3(d) Weighted linear regression Suppose we keep the independence assumption but remove the same variance assumption. In other words, data points would be still sampled independently, but now they may have different variance of. Thus, the covariance matrix of Y would be still diagonal, but with different values: . . . 0 0 (3) Derive the estimator # (similar to the normal equations) for this problem using matrix-vector notations with E. [0.7 pts]Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started