Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Now consider the Perceptron algorithm with Offset. Whenever there is a mistake ( or equivalently, whenever y ^ ( i ) ( theta x

Now consider the Perceptron algorithm with Offset. Whenever there is a "mistake" (or equivalently, whenever y^(i)(\theta x^(i)+\theta _0)<=0 i.e. when the label y^i and h(x) do not match), perceptron updates \theta with \theta +y^(i) x^(i) and \theta _0 with \theta _0+y^(i) More formally, the Perceptron Algorithm with Offset is defined as follows: Perceptron ({(x^(i), y^(i)), i=1,..., n}, T) : initialize \theta =0(vector); \theta _0=0(scalar) for t=1,..., T do for i=1,..., n do if y^(i)(\theta x^(i)+\theta _0)<=0 then update \theta =\theta +y^(i) x^(i) update \theta _0=\theta _0+y^(i) In the next set of problems, we will try to understand why such an update is a reasonable one. When a mistake is spotted, do the updated values of \theta and \theta _0 provide a better prediction? In other words, is y^(i)((\theta +y^(i) x^(i)) x^(i)+\theta _0+y^(i)) always greater than or equal to y^(i)(\theta x^(i)+\theta _0) Yes, because \theta +y^(i) x^(i) is always larger than \theta Yes, because (y^(i))^2x^(i)^2+(y^(i))^2>=0 No, because (y^(i))^2x^(i)^2-(y^i)^2<=0 No, because \theta +y^(i) x^(i) is always larger than \theta /r/n For a given example i, we defined the training error as 1 if y^(i)(\theta x^(i)+\theta _0)<=0, and 0 otherwise: \epsi _i(\theta ,\theta _0)=[[y^(i)(\theta x^(i)+\theta _0)<=0]] Say we have a linear classifier given by \theta ,\theta _0. After the perceptron update using example i, the training error \epsi _i(\theta ,\theta _0) for that example can (select all those apply): Increase Stay the same Decrease

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Public Finance And Public Policy

Authors: Jonathan Gruber

7th Edition

1319281109, 9781319281106

Students also viewed these Databases questions