Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Suppose we have a data set {(x1,y1),..., (XN, YN)}. xi's and labels yi's are both binary: i.e., xi, Yi {0, 1} for all i.
Suppose we have a data set {(x1,y1),..., (XN, YN)}. xi's and labels yi's are both binary: i.e., xi, Yi {0, 1} for all i. We know the generating process of this dataset: for each (xi, Yi), first label y are generated from the Bernoulli distribution: Yi ~ Bernoulli(1/2). In other words, Pr(yi = 1) = Pr(yi = 0) = 1/2. Then, if y = 1, then xi ~ Bernoulli(p), if y = 0, then xi Bernoulli(g). In other words, Pr(xi = 1 | Yi = 1) = p, Pr(xi = 1 | Yi = 0) = q. Suppose p > q, we would like to find the Bayes optimal classifier f* : Y, which predicts label yi based on xi. (i) (Points: 10) What is the Bayes optimal classifier f*(x)? (ii) (Points: 10) Prove that the classifier has minimal risk among all deterministic classifiers. ~
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started