Let$$s consider the following $3-$state MDP$($Markov Decision Process$)$ for a robot trying to walk, the three states being $$Fallen$,$Standing$$ and $$Moving$,$ as shown in the following figure.