Suppose that the Markov chain in Exercise 3 starts at state 1. How many steps will the chain take on average before absorption?

Data From Exercise 3

In Exercises 1–3, find the fundamental matrix of the Markov chain with the given transition matrix. Assume that the state space in each case is {1, 2,............,n}. If reordering of states is necessary, list the order in which the states have been reordered.

Transcribed Image Text:

1/5 0 1/5 1 1/5 0 1/5 0 1/5 0 1/10 0 1/5 0 1/5 0 1/4 1 1/4 0 1/5 1/5 1/4 1/10 1/4