16. Formulate alternative Markov chain models for two policies for repairing a piece of equipment that must be finely adjusted. The equipment can be in any of three conditions: running ( or just repaired), running fairly well, and running poorly. If running well, it will continue in that condition with probability 0. 7, will be running fairly well next week with probability 0.2 and will be running poorly with probability 0.1 If running fairly well, it will continue in the same condition next week with probability 0.6 and will deteriorate with probability 0.4. Under policy 1, the equipment is repaired whenever it starts a week running poorly. It takes a whole week for repairs. Under policy 2, the equipment is repaired whenever it starts a week running fairly well or poor and takes a whole week of repair.

Also determine what percentage of time does the machine spend 'down' under each policy.