Suppose that you have a long sequence constructed by randomly choosing from the five characters a,b,c,d,e with respective probabilities 1/2, 1/6, 1/6, 1/12, 1/12.

 A. What is the entropy of this distribution? Use base 2 logarithms; this is information theory, not statistical mechanics also Find the Huffman code for this distribution.

 

Note: You will have to write small programs to do this quesiton (Code in R language is required for solution)