3.7.1 Consider the Markov chain whose transition probability matrix is given by

The transition probability matrix corresponding to the nonabsorbing states is

Calculate the matrix inverse to I????Q, and from this determine

(a) the probability of absorption into state 0 starting from state 1;

(b) the mean time spent in each of states 1 and 2 prior to absorption.

Transcribed Image Text:

012 3 0 10 0 0 1 0.1 0.2 0.5 0.2 P = 2 0.1 0.2 0.6 0.1 3 0 000 1