For the Markov decision process of Exercise 1, calculate the expectation (E_{mathbf{u}}left[sum_{n=0}^{2} R_{n} mid X_{0}=3 ight]) for

For the Markov decision process of Exercise 1, calculate the expectation \(E_{\mathbf{u}}\left[\sum_{n=0}^{2} R_{n} \mid X_{0}=3\right]\) for the non-stationary policy for which \(u_{0}(i)=0\) for all \(i, u_{1}(i)=1\) for all \(i\), and \(u_{2}(i)=0\) for all \(i\).