Consider a Markov chain Xn,n 0 whose states are the nonnegative integers. Suppose that P0,0 =
Question:
Consider a Markov chain Xn,n ≥ 0 whose states are the nonnegative integers.
Suppose that P0,0 = 1, and let P(j) be the probability of ever entering state 0 given X0 = j . Show that P(Xn), n ≥ 0 is a Doob martingale.
Fantastic news! We've Found the answer you've been seeking!
Step by Step Answer:
Related Book For
Question Posted: