Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Answer question 8 using a programming language of your choice please provide your source code: Nonlinear Transformation In these problems, we again apply Linear Regression

Answer question 8 using a programming language of your choice please provide your source code:

image text in transcribed

Nonlinear Transformation In these problems, we again apply Linear Regression for classification. Consider the target function: f(11, 12) = sign(a +-0.6) Generate a training set of N = 1000 points on x = (-1,1] x [-1,1] with a uniform probability of picking each xe x. Generate simulated noise by flipping the sign of the output in a randomly selected 10% subset of the generated training set. 8. Carry out Linear Regression without transformation, i.e., with feature vector: (1,11,12) to find the weight w. What is the closest value to the classification in sample error Ein? (Run the experiment 1000 times and take the average Ein to reduce variation in your results.) (a) 0 (b) 0.1 (c) 0.3 (d) 0.5 (e) 0.8 9. Now, transform the N = 1000 training data into the following nonlinear feature vector: (1, 11, 12, 1122, 11, 2) (1) Find the vector w that corresponds to the solution of Linear Regression. Which of the following hypotheses is closest to the one you find? Closest here means agrees the most with your hypothesis has the highest probability of agreeing on a randomly selected point). Average over a few runs to make sure your answer is stable. (a) 9(21,12)=sign(-1 -0.05.01 +0.08.02 +0.137112 +1.5x1 +1.522) (b) g(x1, 12) =sign(-1 0.0521 +0.08.02 +0.13.2112 +1.521 + 15x2) (c) g(21, 12) =sign(-1 0.05.01 +0.08.02 +0.13.2112 + 150; +1.5.2) (d) g(21, 12) =sign(-1 1.501 +0.08.12 +0.13.01.02 +0.05xi +0.05x2) (e) g(11, 12) =sign(-1 -0.05.r +0.08.12 +1.50722 +0.15r +0.15x3) Nonlinear Transformation In these problems, we again apply Linear Regression for classification. Consider the target function: f(11, 12) = sign(a +-0.6) Generate a training set of N = 1000 points on x = (-1,1] x [-1,1] with a uniform probability of picking each xe x. Generate simulated noise by flipping the sign of the output in a randomly selected 10% subset of the generated training set. 8. Carry out Linear Regression without transformation, i.e., with feature vector: (1,11,12) to find the weight w. What is the closest value to the classification in sample error Ein? (Run the experiment 1000 times and take the average Ein to reduce variation in your results.) (a) 0 (b) 0.1 (c) 0.3 (d) 0.5 (e) 0.8 9. Now, transform the N = 1000 training data into the following nonlinear feature vector: (1, 11, 12, 1122, 11, 2) (1) Find the vector w that corresponds to the solution of Linear Regression. Which of the following hypotheses is closest to the one you find? Closest here means agrees the most with your hypothesis has the highest probability of agreeing on a randomly selected point). Average over a few runs to make sure your answer is stable. (a) 9(21,12)=sign(-1 -0.05.01 +0.08.02 +0.137112 +1.5x1 +1.522) (b) g(x1, 12) =sign(-1 0.0521 +0.08.02 +0.13.2112 +1.521 + 15x2) (c) g(21, 12) =sign(-1 0.05.01 +0.08.02 +0.13.2112 + 150; +1.5.2) (d) g(21, 12) =sign(-1 1.501 +0.08.12 +0.13.01.02 +0.05xi +0.05x2) (e) g(11, 12) =sign(-1 -0.05.r +0.08.12 +1.50722 +0.15r +0.15x3)

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access with AI-Powered Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Students also viewed these Databases questions