Answered step by step
Verified Expert Solution
Question
1 Approved Answer
In this question we consider derivation of the C, statistic for model selection discussed in lectures. Consider fitting the proposed general linear model and
In this question we consider derivation of the C, statistic for model selection discussed in lectures. Consider fitting the proposed general linear model and write ; for the fitted value at r; and MSE() for its mean squared error. Recall that if the error variance o? is known, then an estimate of E MSE() Jp EVar() E; Bias () is (n - p)( - o) (1) where is the estimate of the residual error variance for the proposed model and p is the number of parameters. Substituting o (the estimated error variance based on a model including all predictors) for o in this expression gives Mallow's Cp. You now have to provide a justification for (1). In what follows, we let X1 be the design matrix for the proposed model, and X2 be the design matrix for the true model. Let B(1) denote the vector of parameters in the proposed model and 3(2) be the vector of parameters for the true model. Write b(1) for the least squares estimator of 8(1) and b2) for the least squares estimator of g(2) (a) Writing for the vector of fitted values for the proposed model and observing that j = X;(X X1)Xy = Hy, show that EVar() = o'tr(H1), where tr(A) denotes the trace of A and H1 = X1(X X1)X denotes the hat matrix corresponding to the proposed model. By using the rules given in lectures about matrix traces, deduce that Var() = p.
Step by Step Solution
★★★★★
3.48 Rating (155 Votes )
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started