Consider the simple MDP shown below. Starting from state s$1,$ the agent can move to the right $($a$0)$ or left $($a$1)$ from any state si$.$ Actions are deterministic $($e$.$g$.$ choosing a$1$ at state s$2$ results in transition to state s$1).$ Taking any action from the goal state G earns a reward of r $=+1$ and the agent stays in state G$.$ Otherwise, each move has zero reward $($r $=0).$ Assume a discount factor $\backslash$gamma $<1.$