b). Suppose that the weather in a certain city is either rainy or dry. As a result of extensive record keeping it has been determined that the probability of a rainy day following a dry day is -, and the probability of a rainy day following a rainy day is - . Let state D be a 2 dry day and state R be a rainy. Suppose that when we begin our observation (0 day), it is dry (i) What is the initial state vector for the Markov process? (ii) What is the transition matrix for the Markov process? (iii) State whether the Markov process reaches the equilibrium