Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

machine learning, i dont understand part b and some parts of d answer is provided, please explain the answer in detail to me 9 (a)

machine learning,
i dont understand part b and some parts of d
answer is provided, please explain the answer in detail to me
image text in transcribed
image text in transcribed
image text in transcribed
image text in transcribed
image text in transcribed
9 (a) A linear fit to the discriminant function g(x) = w x for a two-class Bayes classifier leads to a logistic sigmoid function for the posterior p(C1 | 2). Prove this statement starting from the following expression for the discrim- inant function 9(x) = In PC / x) =W wx p(C2x) (b) Show that the negative log-likelihood for logistic regression training is E(w) =-CIn o(w"x;) + (1 - C:) ln(1 0(w"x;)) where C; {0,1} is the class of training feature x; and w the set of weights. (e) Show for the logistic sigmoid function o(2) that do(2) = o(2) (1 - 0(z)) dz (d) Hence show that the gradient of E in part (b) is n aw C; -o)x; we have: w . slf - W x ) - (+) T 1 , ) w . P (4:01 W) 1 Y Taking independent ply I w ) o (w*x)"(1-'o (WT observations (w "x)) (-) . o the likelihood of - logh (w) given y 1(w) log(a (wa)*( 0(ww.) )*'* *:)) : (8: logowa) = (1 - 7:) log (1-0(wa))) (Q9cd) dz (2) (1e7 c) (1-2) : : (-) -. ( ) -)*() ( : 2 %) * { ) : ( ) 4 e ( from 14 where does this cane (Q9cd) (2-I : : (1-) (14) 11e-1 : () * *(( ) -)*( : ( :12 * ( :( |1=G) (: - . ( () pleare derive T -2 {G 4 2 { (( -1 ) 4 ( - 1) + (x & c } - ) 1 1- ... { (-1) - (:) ( - ) ( 3 (x ; } : ( G - sx ( -) - 3 ( -1) } 2- (8) dox Hence please explain these equations M. 5 Feb 07 6) Odborne have 2013 we slf -() wT*) P (1 T X . olu Tx) (1-'(w+x)) (-4) Y . ply: 11w) ) P (4:0W) 1 PL w o(wx) Taking independent observations To(w'*:)*(1- o (Wx;)) this i the likelihood of w 6(w) - logh (w) . Plog (a (wx)i (k- o(wx:))."'-:)) yiloyo (wx) * ( I -y:) log (1-0 (w7x:))) (w?r:)) (vi) given y 13 11

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Inductive Databases And Constraint Based Data Mining

Authors: Saso Dzeroski ,Bart Goethals ,Pance Panov

2010th Edition

1489982175, 978-1489982179

More Books

Students also viewed these Databases questions

Question

When would you use one approach, and when would you use another?

Answered: 1 week ago