Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Information Theory: Tis question can be answered on excel... Given a language with letter alphabet , of size n = ||, the entropy of the

Information Theory:

Tis question can be answered on excel...

Given a language with letter alphabet , of size n = ||, the entropy of the letters is Hu = log n if all n letters of the alphabet are equally probable. In actual use of the language, this might not be the case and the computed entropy Hexp from texts of the language would be different from Hu. The letter redundancy of the language may be taken as R = 1- Hexp / Hu. This means that only m = (1 R)n letters can be used effectively to write most of the language texts.

The excel screenshot below gives the letter frequencies observed for four different languages (Arabic, English, French and Greek). Given these frequencies, compute Hexp for the given four languages and compare between their redundancies.image text in transcribed

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Practical Database Programming With Visual C# .NET

Authors: Ying Bai

1st Edition

0470467274, 978-0470467275

More Books

Students also viewed these Databases questions

Question

Question What are the advantages of a written bonus plan?

Answered: 1 week ago