Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

In this problem, we will try to understand the loss in Passive-Aggressive (PA) Perceptron algorithm. The passive-aggressive (PA) algorithm (without offset) responds to a labeled

In this problem, we will try to understand the loss in Passive-Aggressive (PA) Perceptron algorithm. The passive-aggressive (PA) algorithm (without offset) responds to a labeled training example (x,y) by finding that minimizes /2||(k)||^2+Lossh(yx) where (k) is the current setting of the parameters prior to encountering (x,y) and Lossh(yx)=max{0,1yx} is the hinge loss. We could replace the loss function with something else (e.g., the zero-one loss). The form of the update is similar to the perceptron algorithm, i.e., (k+1)=(k)+yx but the real-valued step-size parameter is no longer equal to one; it now depends on both (k) and the training example (x,y).

Suppose Lossh(y(k+1)x)>0 after the update. Express the value of in terms of in this case. (Hint: you can simplify the loss function in this case).

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Advances In Databases 28th British National Conference On Databases Bncod 28 Manchester Uk July 2011 Revised Selected Papers Lncs 7051

Authors: Alvaro A.A. Fernandes ,Alasdair J.G. Gray ,Khalid Belhajjame

2011th Edition

3642245765, 978-3642245763

More Books

Students also viewed these Databases questions