A certain machine is in one of four possible states: 0 = working without a problem; 1 = working but in need of minor repair, 2 = working but in need of major repair; 3 = out-of-order. The corresponding transition probability matrix is :(attach)

a. Draw the transition diagram

b. is this chain irreducible

c. Find the classes of the chain

d. Find the transient and recurrent classes

e.

[10 marks) A certain machine is in one of four possible states: 0 = working without a problem; 1 = working but in need of minor repair; 2 = working but in need of major repair; 3 = outt-order. The corresponding transition probability matrix is 0.80 0.14 0.04 0.02 0 0.6 0.3 [1.10 D l] 0.65 [1.35 0.90 0 0 0.10 Draw the transition diagram Is this chain irreducible Find the classes of the chain Find the transient and recurrent classes Find the steady-state distribution of the Markov chain raprises