Consider an irreducible finite Markov chain with states 0, 1,..., N. (a) Starting in state i, what
Question:
Consider an irreducible finite Markov chain with states 0, 1,..., N.
(a) Starting in state i, what is the probability the process will ever visit state /? Explain!
(b) Let x, P(visit state N before state 0 start in ]. Compute a set of linear equations which the x, satisfy, 0, 1, ..., N.
(c) If, jpy i for i = 1,...,N-1, show that x, i/N is a solution to the equations in part (b).
Fantastic news! We've Found the answer you've been seeking!
Step by Step Answer:
Related Book For
Question Posted: