Question 20 1 pts Let P be the transition matrix of a Markov chain with n states. Which one of the following statements is not always true? If Q is another transition matrix of a Markov chain with n states, then =(P + Q) is the transition matrix of a Markov chain with n states. O P2 is the transition matrix of a Markov chain with n states. If P is invertible, then p-1 is the transition matrix of a Markov chain with n states. If Q is another transition matrix of a Markov chain with n states, then PQ is the transition matrix of a Markov chain with n states.Consider the following Markov chain with the following transition diagram on states {1, 2, 3} al- 2 CO 173 3 (a) Is this Markov chain irreducible? [1 marks] (b) Find the probability of the Markov chain to move to state 3 after two time steps, providing it starts in state 2. [3 marks]1. Consider the Markov chain with the following transition matrix. 0 0.5 0.5 0.5 0 0.5 0.5 0.5 0 (a) Draw the transition diagram of the Markov chain. (b) Is the Markov chain ergodic? Give a reason for your answer. (c) Compute the two step transition matrix of the Markov chain. (d) What is the state distribution *2 for t = 2 if the initial state distribution for t = 0 is no = (0.1, 0.5, 0.4)