3.3. Let {V(t) } be the two state Markov chain whose transition probabilities are given by (3.14a-d).

Question:

3.3. Let {V(t) } be the two state Markov chain whose transition probabilities are given by (3.14a-d). Suppose that the initial distribution is (1 - ir, 7r). That is, assume that Pr{ V(0) = 01 = 1 - 7r and Pr{V(0) = 11 = 7r. In this case, show that Pr{V(t) = 1 } = 7r for all times t > 0.

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question

An Introduction To Stochastic Modeling

ISBN: 9780126848878

3rd Edition

Authors: Samuel Karlin, Howard M. Taylor

Question Posted: