solve all

3. A source emits one of four messages randomly every 1 microsecond. The probabilities of these messages are 0.5,0.3,0.1 and 0.1. Messages are generated independently. 3.1 hat is the source entropy? 3.2 Obtain a compact binary code and determine the average length of the code word, the efficiency and the redundancy of the code. 3.3 Obtain a cempact ternary code and determine the average length of the code word, the efficiency, and the redundancy of the code