2. Consider a continuous-time Markov chain {X(t), t 2 0} with the following matrix of transition rates 0 Q V O (a) Draw a graph of this chain, write down the transition matrix of the corresponding embedded Markov chain as well as the transition rates out of each of the states. (b) Obtain the steady-state probabilities of this Markov chain. In preparation for the remainder, we recall the technique of integrating factor for solving first order linear differential equations. (c) Solve the non-homogeneous differential equation Y'(t) = aY (t) + b(t). Symmetry considerations lead to the fact that only 3 distinct transition probability func- tions are needed to complete the matrix of transition probability functions, P(t). Let p(t) = P1I(t), q(t) = P12(t) and r(t) = P41 (t). (d) Express each pij(t) in terms of p(t), q(t) and r(t). Write P(t) in terms of those functions