See below:

Solve the following problems: Question 1 Consider the Markov chain whose transition probability matrix is: 100 0 0 0 0 001 0 0 010 P = 0 - WIH 0 0 0 0 0 0 (a) Classify the states {0, 1, 2, 3, 4, 5} into classes. (b) Identify the recurrent and transient classes of (a)