1. The image below shows a set of eight Scrabble pieces.

a. What is the entropy in bits of the letters in this set?

b. What would be the reduction in entropy (i.e., the information gain)
in bits if we split these letters into two sets, one containing the vowels and the other containing the consonants?

c. What is the maximum possible entropy in bits for a set of eight Scrabble pieces?

d. In general, which is preferable when you are playing Scrabble: a set of letters with high entropy or a set of letters with low entropy?

Transcribed Image Text:

OXYMORON