41. Suppose that the time between successive arrivals of customers at a single-server station are independent random variables having a common distribution F. Suppose that when a customer arrives, it either immediately enters service if the server is free or else it joins the end of the waiting line if the server is busy with another customer. When the server completes work on a customer that customer leaves the system and the next waiting customer, if there are any, enters service. Let Xn denote the number of customers in the system immediately before the rtth arrival, and let Yn denote the number of customers that remain in the system when the nth customer departs. The successive service times of customers are independent random variables (which are also independent of the interarrivai times) having a common distribution G.

(a) If F is the exponential distribution with rate ë, which, if any, of the processes [Xn], [Yn] is a Markov chain?

(b) If G is the exponential distribution with rate ì, which, if any, of the processes [Xn}9 [Yn] is a Markov chain?

(c) Give the transition probabilities of any Markov chains in

(a) and (b).