Suppose that the Markov chain in Exercise 5 starts at state 4. Find the probabilities that the

Question:

Suppose that the Markov chain in Exercise 5 starts at state 4. Find the probabilities that the chain is absorbed at states 1, 2, and 3.

Data From Exercise 5

In Exercises 4–6, find the matrix A = lim_n→∞S_n for the Markov chain with the given transition matrix. Assume that the state space in each case is {1,2,................,n}. If reordering of states is necessary, list the order in which the states have been reordered.