1 Exercise 1: Discounting (50 points) 8 2 a b c d e Given the above world and the following: Actions: West (W), East (E), Exit (x) (only in a ore) Transitions: deterministic Rewards: - -0.01 for each West or East action (cost of living) - 9 for exiting when at a 2 for exiting when at e For y = 0.9, what is the optimal policy? 1 Exercise 1: Discounting (50 points) 8 2 a b c d e Given the above world and the following: Actions: West (W), East (E), Exit (x) (only in a ore) Transitions: deterministic Rewards: - -0.01 for each West or East action (cost of living) - 9 for exiting when at a 2 for exiting when at e For y = 0.9, what is the optimal policy