Question
Bigrams (a) Compute the bigram count table, C(w2|w1) for the sentence I think you can do it. If you think you can do it, you
Bigrams (a) Compute the bigram count table, C(w2|w1) for the sentence I think you can do it. If you think you can do it, you can do it. Put w1 in the left hand column, and w2 in the top row. Include punctuation, clitics, and sentence start and end markers and individual tokens. (b) Compute the bigram probability table, P(w2|w1), for the following sentence, assuming the following overall unigram counts: I think you can do it. C(I) = 50, C(think) = 80, C(you) = 25, C(can) = 40, C(do) = 70, C(it) = 60. Assume there are 50 sentences in the corpus, and they all end with a period. (c) Compute the probability and perplexity of the sentence in (a) using the bigram approximation.
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started