Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Can you please please please answer part d of this question in details with explanation (Thank you!) 3 Linear Regression [2 pts] A closed form

Can you please please please answer part d of this question in details with explanation (Thank you!)

image text in transcribedimage text in transcribed
3 Linear Regression [2 pts] A closed form solution (normal equation) for linear regression problem is as follows: e = (XX)-1XTY. A probabilistic interpretation of linear regression tells us that we are relying on an assumption that each data point is actually sampled from a linear hyperplane, with some noise. The noise follows a zero-mean Gaussian distribution with constant variance. Specifically, Y = oxite (2) 2 where e" ~ N(0, o'[), 0 ER, and {X", Y'} is the i-th data point. In other words, we are assuming that each point is independent to each other and that every data point has the same variance. (a) Using the normal equation, and the model (Eqn. 2), derive the expectation E[0]. Note that here X is fixed, and only Y is random, i.e. "fixed design" as in statistics. [0.4 pts] (b) Similarly, derive the variance Var. [0.4 pts] (c) Under the white noise assumption above, someone claims that o follows Gaussian distribu- tion with mean and variance in (a) and (b), respectively. Do you agree with this claim? Why or why not? [0.5 pts] 3(d) Weighted linear regression Suppose we keep the independence assumption but remove the same variance assumption. In other words, data points would be still sampled independently, but now they may have different variance of. Thus, the covariance matrix of Y would be still diagonal, but with different values: . . . 0 0 (3) Derive the estimator # (similar to the normal equations) for this problem using matrix-vector notations with E. [0.7 pts]

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Advanced Calculus Of A Single Variable

Authors: Tunc Geveci

1st Edition

331927807X, 9783319278070

More Books

Students also viewed these Mathematics questions