Question
Bonus 2. Using a standard (balanced) die, the following sequence of numbers is rolled : 2, 4, 1, 3. Compute the amount of information in
Bonus
2. Using a standard (balanced) die, the following sequence of numbers is rolled : 2, 4, 1, 3. Compute the amount of information in bits for this event (i.e. the minimal amount of information required to store this sequence). (10 points)
3. Consider two die, one being balanced, i.e. the probability of each of the 6 numbers is equal, and one which is loaded where the probability of 2 is 0.2, the probability of 6 is 0.4, and the probability of the other numbers are equal. Compute the entropy an event produced by each of the two dice. (10 points)
4. The entropy of a probability distribution is 3.6 bits. Is this enough information to calculate how many Hartleys the entropy of the same distribution is? If it can be calculated, how many Hartleys is it? How would the answer change if we were asking about nat-s? (10 points)
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started