Let P) and p2) denote transition probability matrices for ergodic Markov chains having the same state space. Let z' and denote the stationary (limiting) probability vectors for the two chains. Consider a process defined as follows:

(i) X = 1.

A coin is then flipped and if it comes up heads, then the remaining states X,... are obtained from the transition probability matrix P) and if tails from the matrix P). Is (X, n 0) a Markov chain? If p = P(coin comes up heads], what is lim, P(X = i]? (ii) X1. At each stage the coin is flipped and if it comes up heads, then the next state is chosen according to P) and if tails comes up, then it is chosen according to P). In this case do the successive states constitute a Markov chain? If so, determine the transition probabilities. Show by a counterexample that the limiting probabilities are not the same as in part (i).