stochastic process

Exercise 5. Let (Xn)n be an irreducible Markov chain with finite state space . Given a state y E 2, consider the number of visits to y at times (EyTy) almost surely as n 1 co. In other words, in the long run, the proportion of time the chain spends at site y is given by (EyTy) -1