5.7. Consider the random walk Markov chain whose transition probability matrix is given by

Starting in state 1, determine the probability that the process is absorbed into state 0. Do this first using the basic first step approach of equations (4.3) and (4.4), and second using the particular results for a random walk given in equation (5.13).

Transcribed Image Text:

01 2 3 1 0 0 0 1 0.3 0 0.7 0 P = 2 0 0.3 0 0.7 3 0 0 0 1