Bonus

2. Using a standard (balanced) die, the following sequence of numbers is rolled : 2, 4, 1, 3. Compute the amount of information in bits for this event (i.e. the minimal amount of information required to store this sequence). (10 points)

3. Consider two die, one being balanced, i.e. the probability of each of the 6 numbers is equal, and one which is loaded where the probability of 2 is 0.2, the probability of 6 is 0.4, and the probability of the other numbers are equal. Compute the entropy an event produced by each of the two dice. (10 points)

4. The entropy of a probability distribution is 3.6 bits. Is this enough information to calculate how many Hartleys the entropy of the same distribution is? If it can be calculated, how many Hartleys is it? How would the answer change if we were asking about nat-s? (10 points)