A Markov chain has state space (mathbf{Z}={0,1,2,3,4}) and transition matrix [mathbf{P}=left(begin{array}{ccccc} 0 & 0.2 & 0.8 &

Question:

A Markov chain has state space \(\mathbf{Z}=\{0,1,2,3,4\}\) and transition matrix

\[\mathbf{P}=\left(\begin{array}{ccccc} 0 & 0.2 & 0.8 & 0 & 0 \\ 0 & 0 & 0 & 0.9 & 0.1 \\ 0 & 0 & 0 & 0.1 & 0.9 \\ 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 0 & 0 \end{array}\right)\]

(1) Draw the transition graph.

(2) Verify that this Markov chain is irreducible with period 3.

(3) Determine the stationary distribution.

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question
Question Posted: