Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Mr. A conducts a series of coin tossing experiments, which are assumed to be independent of one another. For each experiment, you make a

 

Mr. A conducts a series of coin tossing experiments, which are assumed to be independent of one another. For each experiment, you make a bet on the result, namely, heads or tails. Mr. B said "I can predict the result only by observing A's motion of tossing and I'll tell you my prediction before you make a bet." It was examined how correctly B can predict the result only by observing A's motion of tossing. B's performance of prediction is shown in the table below as joint probability P(X,Y) of X for B's predictions and Y for the results of A's experiments. X: B's prediction P(X,Y) head tail Y: head 0.45 0.25 Results tail 0.15 0.15 Answer the following questions, where you can use this table as prior knowledge. Your answer can include the expressions of log 3, log2 5, and log2 7. (1) You make a bet without referring to B's prediction. Answer the entropy (quantity of information) that, for each experiment, you can obtain by knowing the result of the experiment. Show the procedure of calculation. (2) You make a bet after referring to B's prediction. Answer the entropy that you can obtain by knowing the result after you refer to B's prediction. Show the procedure of calculation. (3) Answer the entropy that you can obtain when you refer to B's prediction. Show the procedure of calculation. (4) You make a bet ten times. After you refer to B's prediction, you make a bet. Each time you win, you receive a reward of 100 yen. Answer the following questions. (4-1) You want to maximize the expected value of the total amount of reward. Is it beneficial for you to make a bet by always following B's prediction? Answer with a reason. (4-2) For each experiment, you can select heads, tails or pass after you refer to B's prediction. Here, pass means that you do not make a bet and proceed to the next experiment. When you make a bet ten times eventually, the tossing experiments end. In this condition, is it beneficial for you to refer to B's predictions? Answer with a reason. The coin tossing experiment can be modeled as random variable Z that takes one of the two symbols (Z, Z} as its value. Here, we consider a general case where the number of symbols is N (N>2) for Z. Answer the following questions related to the entropy that you can obtain by knowing the value of Z. (5) Answer the probability distribution of P(Z) that maximizes the entropy. Your answer must be with a mathematical proof.

Step by Step Solution

3.36 Rating (159 Votes )

There are 3 Steps involved in it

Step: 1

1 The entropy of a single coin toss without knowing Bs prediction can be calculated as follows HY PY log2 PY Where Y is the result of the coin toss he... blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Introduction to Probability

Authors: Mark Daniel Ward, Ellen Gundlach

1st edition

716771098, 978-1319060893, 1319060897, 978-0716771098

More Books

Students also viewed these Finance questions

Question

Are the hours flexible or set?

Answered: 1 week ago