Answered step by step
Verified Expert Solution
Link Copied!

Question

00
1 Approved Answer

4 PAC - Learning of Axis - Aligned Boxes [ 8 + 1 0 = 1 8 points ] In this problem, we consider the

4 PAC-Learning of Axis-Aligned Boxes [8+10=18 points]
In this problem, we consider the class of n-dimensional axis-aligned boxes. Each function c in this class is specified by a
set of 2n values l1,dots,ln and u1,dots,un in 0,1, which defines an axis-aligned n-dimensional box. Given an n-dimensional
input vector x,c(x) is defined to be 1(or '+') if for every iin{1,dots,n} the i'th coordinate of x lies in li,ui. Otherwise,
c(x) is defined to be 0(or '-').
An example of a 2-dimensional axis-aligned box is shown in the figure below.
(a) Let C be the class of n-dimensional axis-aligned boxes, and cinC be the unknown target function. State an efficient
algorithm that takes as input an arbitrary set of points x1,x2,dots,xm each a point in n-dimensional space, and their
corresponding labels c(x1),c(x2),dots,c(xm), and outputs a function hinC that is consistent with this data. Your
algorithm should run in polynomial time in m,n and facilitate answering part (b) below.
(b) Let D be an arbitrary, unknown distribution, and let c be an arbitrary, unknown n-dimensional axis-aligned box.
Suppose your algorithm from part (a) is given as input m points x1,x2,dots,xm drawn i.i.d. from D and their
corresponding labels c(x1),c(x2),dots,c(xm). Let h be the function output by your algorithm. Let and lon be fixed
parameters in (0,12). Without referring to VC dimension, state and prove an upper bound for m to ensure accuracy
lon with confidence parameter ? Don't worry about getting the best possible constant factors in your bound, just focus
on the important parameters (n,,lon).
Hint: you can use the fact that (1-x)1n1-xn for any x1 and positive integer n.
image text in transcribed

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access with AI-Powered Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Students also viewed these Databases questions