Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

could you help me on this problem ? Thank you . In this exercise, we solve a simple optimization problem related to the multinomial naive

could you help me on this problem ? Thank you .

image text in transcribed
In this exercise, we solve a simple optimization problem related to the multinomial naive Bayes classifier. Fix a finite set % = (x1,...,XM} and real numbers c1, . .., CM 2 0. Consider the following optimiza tion problem W = argmax L(w) := _ clog wi (1) W=[WI....>WM]TERM 1= 1 subject to: wis a PMF on . We will show that the solution is given by C1 CM W = , . . (2) E Ci (i)) The constraint set of (1) is the 'simplex' 6 = (we RM|0 S w1, . .., WM S 1, EM, w; = 1). Denote the larger constraint set 6 = (we RM | EM, wi = 1). Let A ER be a Lagrange multiplier for 6. Then the Lagrangian is M g (1, w) = L(w) -_ _ wi -1. (3) Show that 1 needs to satisfy ag(1, w) C1 CM - A [1,. .., 1] = 0. (4) Ow W1 WM Conclude that (2) is the global maximum L(w) over 6. (ii) From (i), conclude that (2) is the global maximum L(w) over 6

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

The Structure Of Groups With A Quasiconvex Hierarchy (AMS-209)

Authors: Daniel T Wise

1st Edition

069121350X, 9780691213507

More Books

Students also viewed these Mathematics questions