A Markov chain has state space (mathbf{Z}={0,1,2,3,4}) and transition matrix [mathbf{P}=left(begin{array}{ccccc} 0 & 0.2 & 0.8 &
Question:
A Markov chain has state space \(\mathbf{Z}=\{0,1,2,3,4\}\) and transition matrix
\[\mathbf{P}=\left(\begin{array}{ccccc} 0 & 0.2 & 0.8 & 0 & 0 \\ 0 & 0 & 0 & 0.9 & 0.1 \\ 0 & 0 & 0 & 0.1 & 0.9 \\ 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 0 & 0 \end{array}\right)\]
(1) Draw the transition graph.
(2) Verify that this Markov chain is irreducible with period 3.
(3) Determine the stationary distribution.
Fantastic news! We've Found the answer you've been seeking!
Step by Step Answer:
Related Book For
Applied Probability And Stochastic Processes
ISBN: 9780367658496
2nd Edition
Authors: Frank Beichelt
Question Posted: