Given the Markov Decision Process showing above, answer the following questions:

What is the transition matrix vec$(P)?($please follow the same state order we used: C$1,$ C$2,$ C$3,$ Pass, Bar, FB$,$ Sleep$)$

What is the reward vector vec$(r)?($follow the same state order: C$1,$ C$2,$ C$3,$ Pass, Bar, FB$,$ Sleep$)$

Modify the Matlab code on Canvas, run the code:

$3\mathrm{.}1.$ when $=0\mathrm{.}9,$ what is the state$-$value $(V-$function value$)$ for each state?

$3\mathrm{.}2.$ when $=0\mathrm{.}1,$ what is the state$-$value $(V-$function value$)$ for each state?

$2$