hi! i need help w this one. whatever is provided by the professor is attached

Question 1. In the figure below you can see one example we discussed in class involving Markov decision processes. Write down the Bellman equations for a random policy you generate and for the optimal policy we discussed in class. Notice that the arrow below is pointing East (E) but it can also point North (N), South(S) or West (W). Justify the idea that we have a non-zero probability to go backwards (0.1). Assume a reward of -0.02 for all states and a discount value of 0.9. Solve the Bellman equation for both policies. Fo(Vmm 50S 71 ,frvm S 35' VT(S) 30.1