Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

4. [17 pts] Consider a weighted multiple linear regression model with n observations and p predictors, Y = XB + e, where Y = (Yi....,

image text in transcribed
image text in transcribed
4. [17 pts] Consider a weighted multiple linear regression model with n observations and p predictors, Y = XB + e, where Y = (Yi...., Y.) is the n x 1 vector of responses; X is the n x (p + 1) matrix of predictors, including a column of 1's for the intercept; and e = (c1, ....6.) is the n x 1 vector of statistical errors. Here er's are independent normal random variables with mean 0 and variance o'/wj. The values of fur : i = 1, ... .n) are known. Let Y = (Y1. ..., Y.) denote the fitted values from the WLS estimation and e = Y - Y denote the corresponding residuals. (Note: please clearly define new notations if needed, and show all the derivation steps for the following questions) (a) [4 pts] Derive the specific form of Var(e | X). (b) [4 pts) Derive the specific form of Cou(e, Y | X). (c) [4 pts] Conditional on X's, write the likelihood function of the observed responses, and derive the specific form of the maximum likelihood estimator of o?. Hint: recall that the probability density function of a Normal random variable Z with mean a and variance b' is P(=) = V2 TUz (d) [5 pts] For the considered WLS model, specify how the ridge regression estimator of B is defined (suppose the intercept is not penalized). Derive the specific form of this ridge regression estimator (suppose both the responses and predictors are standardized)

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Interconnection Networks

Authors: J C Bermond

1st Edition

1483295273, 9781483295275

More Books

Students also viewed these Mathematics questions

Question

3. What is my goal?

Answered: 1 week ago

Question

2. I try to be as logical as possible

Answered: 1 week ago