Please help with exercise 3

Example 3 (Operating a GasFired Power Plant) A power company is considering renting a two-regime gasrfired power plant over the (discrete) time [0,T]. In order to figure out whether or not this is worthwhileI the company must figure out the optimal operating policy for the plant. At any time t the company can Operate the plant in "shut-dOwn'I mode, low-capacity mode or high-capacity mOde. The relevant details for each Of these three Operating states are: 0 Shut-down mode: plant rent K O Low capacity mode: output 9, gas consumption , plant rent K O High capacity mode: output a, gas consumption F, plant rent X If the plant is currently in operation then shutting the plant down will incur a ramp-down cost of 05. Similarly, if the plan is currently shut down, then moving it into a low / high production mode will incur a ramp-up cost of C\". We use at E {0 E plant shut-down, 1 E plant Operating} to denote the time t state of the plant. In each periOd there are twO possible actiOns a E {0 E Operate in shut-down mOde, 1 E Operate in productiOn mOde}. We let Vt(s, P, G) denOte the Optimal profit Of the plant over the horizon [t, T] when the current state is s, the current price Of electricity is P. and the current price of gas is G. We also have the following additional notation: o c(s,a): cost Of taking action a when the plant is in state 3 O u(s,a): new state Of the plant when action a. is taken in state 3 Specific values are: c(0,0) = K u(0,0) = 0 (203,1) = Cu+K u(0,1) _ 1 C(1,U) = OddK \"(1,0) = U C(1,1) = mjn{K+G:HPt,+GtPtg} \"(1,1) = 1 Note that when the plant is in production mode one has the choice to run it at the low or high capacity mode. We can now write the standard dynamic programming iteration: thst: Phat) = 033%} c(3twa) + quEE') [%+1(u(8t1a)1a+llat+1)]} (5) where E] denotes the usual risk-neutral expectation conditional on all known-information at time t, r- is the continuously compounded risk-free rate and At is the length of a period. There are two sources of uncertainty here: the price dynamics of electricity and gas. It is straightfomard to construct lattices for these prices and solve (5) numerically beginning at time T and working backwards. I Exercise 3 How should we choose the appmprfate EMM, Q, to use in