=+8.18.

(a) Let 7 be the smallest integer for which X, = ig. Suppose that the state space is finite and that the p, are all positive. Find a p such that max;(1 - pii) sp <1 and hence P.[7 > n] ≤p" for all i.