Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

4. (20 points) Consider the following method for generating a code for a random vari- able X which takes on m values {1,2,...,m} with

 

4. (20 points) Consider the following method for generating a code for a random vari- able X which takes on m values {1,2,...,m} with probabilities p... Pm. Define i-1 F = Pk k=1 the sum of the probabilities of all symbols less than i. Then the codeword for i is the binary representation of number F = [0, 1] rounded off to l; bits, where li = [log1 11 1 16 16 (a) (5 points) Construct the code for the probability distribution (2) (b) (5 points) Show that the code constructed by this process is a prefix code. (c) (5 points) Show that in general if p is a dyadic distribution, i.e., p = 2- for some positive integer ls, the average length for this code matches H(X). (d) (5 points) Show that there are sources where the relative gap to entropy L/H(X) is arbitrarily large.

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Introduction To Probability Statistics And Random Processes

Authors: Hossein Pishro-Nik

1st Edition

0990637204, 9780990637202

More Books

Students also viewed these Programming questions

Question

What is absorbed by water to give it a cyan color?

Answered: 1 week ago

Question

=+b) What if those two probabilities are reversed?

Answered: 1 week ago

Question

Explain the pages in white the expert taxes

Answered: 1 week ago

Question

Why do bars offer free peanuts?

Answered: 1 week ago