A thinker who owns 4 umbrellas travels back and forth between home and office, taking along an umbrella (if there is one at hand) in rain (probabilityp) but not in shine (probabilityq=1). Let the state be the number of umbrellas at hand, irrespective of whether the thinker is at home or at once. Set up the transition matrix and find the stationary probabilities.