Let {X_n}_{n > 0} be an irreducible and positive recurrent Markov chain, and let its expected first return time to i, starting from i. Also, let e_i,j denote the expected number of times the chain, starting from i, visits j starting from time point 0, till before it makes its first return to i. Show that:

 

eij