Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

can someone help me figure this out? Consider the following sentence: I was happy because I knew my mom was happy and because I knew

can someone help me figure this out? image text in transcribed
Consider the following sentence: "I was happy because I knew my mom was happy and because I knew I should feel happy, but I was not happy." a) Compute the bigram count table, C(w2w1) for the sentence. Put w1 in the left hand column, and w2 in the top row. Include punctuation, clitics, and sentence start and end markers as individual tokens, and index words using their lemmatized forms. (5 points) b) Compute them probability table, P(w2w1) assuming the following overall unigram counts: C(I)=2,C (was )=1,C (happy )=20,C (because )=10,C(knew)=80,C(my)=90,C(mom)=50, C( and )=20,C (should )=80,C( feel )=60,C()=10,,C( but )=80,C( not )=10. Assume there are 75 sentences in the corpus, and they all end with a period. (5 points) c) Compute the probability and perplexity of the first sentence in (a) using the bigram approximation. (5 points) d) Smooth the count table you calculated in (a) using Laplace smoothing, and recalculate the probability table as well. Assume V=30. (10 points) e) Recalculate the probability and perplexity of the first sentence in (a) using the smoothed table. (5 points)

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image_2

Step: 3

blur-text-image_3

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Database Development For Dummies

Authors: Allen G. Taylor

1st Edition

978-0764507526

More Books

Students also viewed these Databases questions

Question

True or False. Some rational functions have holes in their graph.

Answered: 1 week ago