Consider a Markov chain on {1,2,3,4,5} with transition matrix a. What are the recurrent and transient classes

Question:

Consider a Markov chain on {1,2,3,4,5} with transition matrix 

a. What are the recurrent and transient classes for this chain?
b. Find the limiting matrix for each recurrent class.
c. Determine the long-range probabilities for the Markov chain starting from each transient state.

d. Use the results of parts (b) and (c) to find

e. Confirm your answer in part (d) by taking P to a high power.

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question

Linear Algebra And Its Applications

ISBN: 9781292351216

6th Global Edition

Authors: David Lay, Steven Lay, Judi McDonald

Question Posted: