5. (15 points) V(s), Q(s, a), Te(s) 0.59 0.67 0.77 0.57 0.64 0.60 0.74 0.66 0.85 1.00 0.67 0.53 0.57 0.57 0.57 The Q-Values of a gridworld problem after many iterations are shown on the diagram 1.00 is the positive exit (escape from the gridworld), and -1.00 is the negative exit (death) 0.51 0.51 0.53 -0.60 -1.00 0.46 0.49 0.30 0.48 0.40 -0.65 10.45 0.41 0.43 0.42 0.40 0.29 0.28 0.13 0.44 0.40 0.41 0.27 a) What are V-Values? Show them on a similar diagram with possible direction symbols. b) Write the policies that can be derived from the final V-Values. The agent will start from one of the bottom squares. c) Why is it better to use discounted utility when calculating rewards for an agent