Answered step by step
Verified Expert Solution
Question
1 Approved Answer
4. (20 points) Consider the following method for generating a code for a random vari- able X which takes on m values {1,2,...,m} with
4. (20 points) Consider the following method for generating a code for a random vari- able X which takes on m values {1,2,...,m} with probabilities p... Pm. Define i-1 F = Pk k=1 the sum of the probabilities of all symbols less than i. Then the codeword for i is the binary representation of number F = [0, 1] rounded off to l; bits, where li = [log1 11 1 16 16 (a) (5 points) Construct the code for the probability distribution (2) (b) (5 points) Show that the code constructed by this process is a prefix code. (c) (5 points) Show that in general if p is a dyadic distribution, i.e., p = 2- for some positive integer ls, the average length for this code matches H(X). (d) (5 points) Show that there are sources where the relative gap to entropy L/H(X) is arbitrarily large.
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started