Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Problem 1 (PERCEPTRON CONVERGENCE) = (a) Assume that (21, y),..., (Xm, Ym), di Rd, Yi E {+1, -1}, Vi [m] is separable, let B =
Problem 1 (PERCEPTRON CONVERGENCE) = (a) Assume that (21, y),..., (Xm, Ym), di Rd, Yi E {+1, -1}, Vi [m] is separable, let B = min{||0|| : Vi E [m], y;wTIi > 1}, and let R= max || 21 ||. Prove that the Perceptron algorithm ie[m] stops after at most (RB)2 iterations, and when it stops it holds that Vi e [m], ywTx; > 0. (b) For the homogeneous Perceptron (i.e., with zero bias), prove that (a) is tight in the following sense: For any positive integer m, there exist a vector wt e Rd (for some appropriate d) and a sequence of examples {(x1, y),..., (I'm, Ym)} such that the following hold: i. R = max ||*|| 1. Note that, using the notation in (a), we therefore get B = min{||w|| : Vi [m], yiwFri > 1}
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started