Let P(t)=[pij (t)] be the finite-time transition matrix of a finite-state irreducible Markov chain. Show that pij

Question:

Let P(t)=[pij (t)] be the finite-time transition matrix of a finite-state irreducible Markov chain. Show that pij (t) > 0 for all i, j, and t > 0.

Thus, no state in a continuous-time chain displays periodic behavior.

(Hint: Use Problem 8.)

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question
Question Posted: