ANSWER ALL $4$ PARTS

Using the Bellman equation, calculate $V_{}(s).$

$($

Given $=0\mathrm{.}8,$ using the Bellman equation. calculate $O_m(s.a)$

Given $=0\mathrm{.}8,$ using the Bellman equation, calculate the optimal value function $V^{**}(s)$

Given $=0\mathrm{.}8,$ using the Bellman equation, calculate the optimal Q$-$function $Q^{**}(s,a)$