Question
Information Theory: Tis question can be answered on excel... Given a language with letter alphabet , of size n = ||, the entropy of the
Information Theory:
Tis question can be answered on excel...
Given a language with letter alphabet , of size n = ||, the entropy of the letters is Hu = log n if all n letters of the alphabet are equally probable. In actual use of the language, this might not be the case and the computed entropy Hexp from texts of the language would be different from Hu. The letter redundancy of the language may be taken as R = 1- Hexp / Hu. This means that only m = (1 R)n letters can be used effectively to write most of the language texts.
The excel screenshot below gives the letter frequencies observed for four different languages (Arabic, English, French and Greek). Given these frequencies, compute Hexp for the given four languages and compare between their redundancies.
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started