Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

We have each data point x = [ [ x _ 1 x _ 2 ] ] ^ T in ^ 2 , and we

We have each data point x=[[ x_1 x_2]]^T in ^2, and we encounter the following data points: We are going to build a linear model (i.e., using least square) to predict the label of each data point x=(x_1, x_2) as follows: =w_0+w_1 x_1+w_2 x_2 where (w_0, w_1, w_2) are unknown weights that we will learn based on the above training dataset. Here w_0 is the intercept. (a) Gradient descent. Starting with (w_0, w_1, w_2)=(0,0,0), we will run the gradient descent algorithm to learn these weights. Run for T=4 iterations and report the value of the weights and the corresponding total error at the end of each iteration. The learning rate is \alpha =0.02. Note. For this question, you can compute each step manually or write a python program for it. If you write a python program, you will need to submit the program together with your answers. 1(b) Closed-form solution. Now we are going to use the closed-form solution to find (w_0, w_1, w_2). Provide the values of (w_0, w_1, w_2). What is the corresponding total error? Note. For this question, you are allowed to use any tool to perform matrix inverse or multiplication.

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Machine Learning And Knowledge Discovery In Databases European Conference Ecml Pkdd 2018 Dublin Ireland September 10 14 2018 Proceedings Part 1 Lnai 11051

Authors: Michele Berlingerio ,Francesco Bonchi ,Thomas Gartner ,Neil Hurley ,Georgiana Ifrim

1st Edition

3030109240, 978-3030109240

More Books

Students also viewed these Databases questions

Question

Write the difference between sexual and asexual reproduction.

Answered: 1 week ago

Question

What your favourite topic in mathematics?

Answered: 1 week ago

Question

Briefly describe vegetative reproduction in plants.

Answered: 1 week ago

Question

=+differences in home- and host-country costs of living?

Answered: 1 week ago

Question

=+derived from the assignment will balance the costs?

Answered: 1 week ago