Consider a time-reversible continuous-time Markov chain having param- eters v., P., and having limiting probabilities P,, j

Question:

Consider a time-reversible continuous-time Markov chain having param- eters v., P., and having limiting probabilities P,, j 0 Choose some state say state 0-and consider the new Markov chain, which makes state 0 an absorbing state That is, reset v to equal 0 Suppose now at time points chosen according to a Poisson process with rate A, Markov chains all of the above type (having 0 as an absorbing state)are started with the initial states chosen to be j with probability Po,. All the existing chains are assumed to be independent Let N,(t) denote the number of chains in state j, j > 0, at time

(a) Argue that if there are no initial chains, then N,(t), j > 0, are independent Poisson random variables

(b) In steady state argue that the vector process {(N,(t), N(t), )} is time reversible with stationary probabilities = P(n) [e = n' for n (n,, n, ), 1-1 where

a, = XP,/Povo

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question

Stochastic Processes

ISBN: 9780471120629

2nd Edition

Authors: Sheldon M. Ross

Question Posted: