4.1. Consider the Markov chain on (0, 1} whose transition probability matrix is (a) Verify that (Iro,

Question:

4.1. Consider the Markov chain on (0, 1} whose transition probability matrix is

image text in transcribed

(a) Verify that (Iro, ir,) = ((3/(a + /3), al(a + (3)) is a stationary distribution.

(b) Show that the first return distribution to state 0 is given by f.(') _ (1 -

a) and f . " ' ) = a/3(1 - /3)i-2 f o r n = 2, 3, ... .

(c) Calculate the mean return time mo = Y,'_, nff'' and verify that Trp = 1 /mo.

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question

An Introduction To Stochastic Modeling

ISBN: 9780126848878

3rd Edition

Authors: Samuel Karlin, Howard M. Taylor

Question Posted: