3.2.1 Consider the Markov chain whose transition probability matrix is given by Suppose that the initial distribution

Question:

3.2.1 Consider the Markov chain whose transition probability matrix is given by

image text in transcribed

Suppose that the initial distribution is pi D 14 for i D 0;1;2; 3. Show that PrfXn D kg D 1 4 ; k D 0;1;2; 3, for all n. Can you deduce a general result from this example?

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question

An Introduction To Stochastic Modeling

ISBN: 9780233814162

4th Edition

Authors: Mark A. Pinsky, Samuel Karlin

Question Posted: