Q2. MDPs - Policy Iteration (20 points) Consider the following transition diagram, transition function and reward function for an MDP. Discount Factor, y = 0.5 A a STs,a,s') Ris,a,s") Clockwise B 1.0 0.0 A Counterclockwise C 1.0 -2.0 B Clockwise 0.4 -1.0 B Clockwise 0.6 2.0 0.6 2.0 0.4 -1.0 A 0.6 2.0 B B Counterclockwise A B Counterclockwise C C Clockwise C Clockwise Counterclockwise A c Counterclockwise B B 0.4 2.0 0.4 2.0 0.6 0.0 Q1.1. Suppose we are doing policy evaluation, by following the policy given by the left-hand side table below. Our current estimates at the end of some iteration of policy evaluation of the value of states when following the current policy is given in the right-hand side table. Provide the value of V+1(A), V+1(B), and V+1(C) B V(A) V(B) (C) Counterclockwise Counterclockwise Counterclockwise 0.000 -0.840 -1.080