Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Bigrams (a) Compute the bigram count table, C(w2|w1) for the sentence I think you can do it. If you think you can do it, you

Bigrams (a) Compute the bigram count table, C(w2|w1) for the sentence I think you can do it. If you think you can do it, you can do it. Put w1 in the left hand column, and w2 in the top row. Include punctuation, clitics, and sentence start and end markers and individual tokens. (b) Compute the bigram probability table, P(w2|w1), for the following sentence, assuming the following overall unigram counts: I think you can do it. C(I) = 50, C(think) = 80, C(you) = 25, C(can) = 40, C(do) = 70, C(it) = 60. Assume there are 50 sentences in the corpus, and they all end with a period. (c) Compute the probability and perplexity of the sentence in (a) using the bigram approximation.

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image_2

Step: 3

blur-text-image_3

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Students also viewed these Databases questions

Question

explain how to create and maintain a differential advantage

Answered: 1 week ago

Question

=+ explain how drugs and other chemicals. affect neurotransmission.

Answered: 1 week ago

Question

List the advantages and disadvantages of the pay programs. page 505

Answered: 1 week ago