Question: Show that if (Y) is a Markov chain on two states, then the off-diagonal elements of (Y), in their columns, are proportional to the probabilities

Show that if \(Y\) is a Markov chain on two states, then the off-diagonal elements of \(Y\), in their columns, are proportional to the probabilities of a stationary distribution \(x\) of \(Y\). That is, if9 Y = a C

then \(\left(\begin{array}{ll}c & b\end{array}\right)=(c+b) x^{\top}\). Exactly when is \(x\) unique? Argue carefully.

9 Y = a C

Step by Step Solution

3.50 Rating (160 Votes )

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Basic Mathematics Questions!