Exercise 2.7 The current controller visits the locations in the todo list sequentially.

(a) Change the controller so that it is opportunistic; when it selects the next location to visit, it selects the location that is closest to its current position. It should still visit all of the locations.

(b) Give one example of an environment in which the new controller visits all of the locations in fewer time steps than the original controller.

(c) Give one example of an environment in which the original controller visits all of the locations in fewer time steps than the modified controller.

(d) Change the controller so that, at every step, the agent heads toward whichever target location is closest to its current position.

(e) Can the controller from part

(d) get stuck in a loop and never reach a target in an example where the original controller will work? Either give an example in which it gets stuck in a loop and explain why it cannot find a solution, or explain why it does not get into a loop.