Consider an irreducible finite Markov chain with states 0, 1,..., N. (a) Starting in state i, what

Question:

Consider an irreducible finite Markov chain with states 0, 1,..., N.

(a) Starting in state i, what is the probability the process will ever visit state /? Explain!

(b) Let x, P(visit state N before state 0 start in ]. Compute a set of linear equations which the x, satisfy, 0, 1, ..., N.

(c) If, jpy i for i = 1,...,N-1, show that x, i/N is a solution to the equations in part (b).

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question
Question Posted: