Q$6$ :

$1.$ For Markov decision Problem how to define states, actions, rewards, and transitions for a specific problem?

$2.$ How to solve an MDP

$3.$ What are the methods to solve an MDP $($e$.$g$.,$ Value Iteration, Policy Iteration$)?$

$4.$ How to choose an appropriate discount factor gamma $$

$5.$ Strategies to deal with large or continuous state spaces.

$6.$ Provide some tips for implementing MDPs in code.

$7.$ Provide some examples of MDPs in real$-$world applications.