Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Because the extrinsic evaluations are realistic but expensive, you have learned an intrinsic evaluation metric, the perplexity PP(W) = (W)/, where n indicates the

Because the extrinsic evaluations are realistic but expensive, you have learned an intrinsic evaluationQ3.2 5 Points Now you measure the perplexity of an unseen weather reports data with 92, and the perplexity ofQ3.3 5 Points When you are evaluating the perplexity as stated above, what will happen if the test data

Because the extrinsic evaluations are realistic but expensive, you have learned an intrinsic evaluation metric, the perplexity PP(W) = (W)/", where n indicates the length of the test data W = ww2...wn by concatenating all sentences. You measured q(W) by a language model learned on a training data. In particular, you have two different but same amount of datasets D: whether reports and D: phone conversations. Two trigram models 9 and 92 are learned on D and D2, respectively. Suppose you measure the perplexity of an unseen weather reports data with 9, and the perplexity of an unseen phone conversation data of the same length with q2. Explain which perplexity is likely higher than the other. Q3.2 5 Points Now you measure the perplexity of an unseen weather reports data with 92, and the perplexity of an unseen phone conversation data of the same length with q. If the perplexity measured with 91 is lower, can you conclude that q is a better model than 92? Yes O No Q3.3 5 Points When you are evaluating the perplexity as stated above, what will happen if the test data consists of some unseen words that you have never observed in the training data? (select all correct) If use smoothing method, p(unseen word)>0 If use smoothing method, p(unseen word)=0 If use smoothing method, we can compute perplexity If use smoothing method, we can not compute perplexity

Step by Step Solution

3.27 Rating (147 Votes )

There are 3 Steps involved in it

Step: 1

1 Suppose you measure the perplexity of an unseen weather report data with q and the perplexity of an unseen phone conversation data of the same lengt... blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Practical Management Science

Authors: Wayne L. Winston, Christian Albright

5th Edition

1305631540, 1305631544, 1305250907, 978-1305250901

More Books

Students also viewed these Programming questions