Consider a Markov chain with states 0, 1, 2, ... and such that P+ p. 1 P-

Question:

Consider a Markov chain with states 0, 1, 2, ... and such that P+ p. 1 P- -

where po 1. Find the necessary and sufficient condition on the p,'s for this chain to be positive recurrent, and compute the limiting probabilities in this case.

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question

Stochastic Processes

ISBN: 9780471120629

2nd Edition

Authors: Sheldon M. Ross

Question Posted: