4.1. Consider the Markov chain on (0, 1} whose transition probability matrix is (a) Verify that (Iro,
Question:
4.1. Consider the Markov chain on (0, 1} whose transition probability matrix is
(a) Verify that (Iro, ir,) = ((3/(a + /3), al(a + (3)) is a stationary distribution.
(b) Show that the first return distribution to state 0 is given by f.(') _ (1 -
a) and f . " ' ) = a/3(1 - /3)i-2 f o r n = 2, 3, ... .
(c) Calculate the mean return time mo = Y,'_, nff'' and verify that Trp = 1 /mo.
Fantastic news! We've Found the answer you've been seeking!
Step by Step Answer:
Related Book For
An Introduction To Stochastic Modeling
ISBN: 9780126848878
3rd Edition
Authors: Samuel Karlin, Howard M. Taylor
Question Posted: