Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Problem 2.24 Consider a simplified learning scenario. Assume that the input dimension is one. Assume that the input variable x is uniformly distributed in the
Problem 2.24 Consider a simplified learning scenario. Assume that the input dimension is one. Assume that the input variable x is uniformly distributed in the interval (-1,1]. The data set consists of 2 points {x1,22} and assume that the target function is f(x) = x2. Thus, the full data set is D= {(21,2), (C2,22)}. The learning algorithm returns the line fitting these two points as 9 (H consists of functions of the form h(x) = ax + b). We are interested in the test performance (Eout) of our learning system with respect to the squared error measure, the bias and the var. (a) Give the analytic expression for the average function g(x). (b) Describe an experiment that you could run to determine (numerically) g(x), Eout, bias, and var. (c) Run your experiment and report the results. Compare Eout with bias+var. Provide a plot of your g(x) and f(x) (on the same plot). (d) Compute analytically what Eout, bias and var should be. Problem 2.24 Consider a simplified learning scenario. Assume that the input dimension is one. Assume that the input variable x is uniformly distributed in the interval (-1,1]. The data set consists of 2 points {x1,22} and assume that the target function is f(x) = x2. Thus, the full data set is D= {(21,2), (C2,22)}. The learning algorithm returns the line fitting these two points as 9 (H consists of functions of the form h(x) = ax + b). We are interested in the test performance (Eout) of our learning system with respect to the squared error measure, the bias and the var. (a) Give the analytic expression for the average function g(x). (b) Describe an experiment that you could run to determine (numerically) g(x), Eout, bias, and var. (c) Run your experiment and report the results. Compare Eout with bias+var. Provide a plot of your g(x) and f(x) (on the same plot). (d) Compute analytically what Eout, bias and var should be
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started