3.3. Let {V(t) } be the two state Markov chain whose transition probabilities are given by (3.14a-d).
Question:
3.3. Let {V(t) } be the two state Markov chain whose transition probabilities are given by (3.14a-d). Suppose that the initial distribution is (1 - ir, 7r). That is, assume that Pr{ V(0) = 01 = 1 - 7r and Pr{V(0) = 11 = 7r. In this case, show that Pr{V(t) = 1 } = 7r for all times t > 0.
Fantastic news! We've Found the answer you've been seeking!
Step by Step Answer:
Related Book For
An Introduction To Stochastic Modeling
ISBN: 9780126848878
3rd Edition
Authors: Samuel Karlin, Howard M. Taylor
Question Posted: