Answered step by step
Verified Expert Solution
Question
1 Approved Answer
(f) Consider the space of all real-valued random variables with finite-variance. Show that this is a vector space, and call it S. (g) Note that
(f) Consider the space of all real-valued random variables with finite-variance. Show that this is a vector space, and call it S. (g) Note that for X, Y c S, we may view E[XY] as a function mapping S x S - R. Show that this is a valid inner product on this vector space. (h) For any pair of finite variance random variables (X, Y), the conditional expectation E[Y(X] is a function of X that is known to satisfy the following property: for all functions d E[(Y - E[YIX])$(X)] = 0. Using this definition, prove that the mean squared error E[(Y -(X ))"] of estimating Y from X is minimized by choosing o(X) = E[Y [X]. L.e., the conditional expectation minimizes the mean squared error of estimation. Hint: Think about how we proved the orthogonality principle without necessarily trying to formally define a subspace
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started