Consider a Markov chain Xn,n 0 whose states are the nonnegative integers. Suppose that P0,0 =

Question:

Consider a Markov chain Xn,n ≥ 0 whose states are the nonnegative integers.

Suppose that P0,0 = 1, and let P(j) be the probability of ever entering state 0 given X0 = j . Show that P(Xn), n ≥ 0 is a Doob martingale.

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question
Question Posted: