Consider the Markov chain with state space {1, 2} such that p1,2 = a and p2,1 = b, where a, b (0, 1). Write down the full transition matrix. Using the Chapman-Kolmogorov equations, show by induction that p1,1^n=a(1-a-b)^n+b/a+b Find the other n-step transition probabilities