Considering Netflix's personalised video recommendation for an individual, where Netflix suggests a genre from the available list of genres $(\{$a$,$ b$,$ c$,$ d$\})$ and observes the reward $($satisfactory rating$)\{0,1,2,3\}$ from the individual, let's analyse the following sequence of tried genres and rewards: $1$: $($a$,2),2$: $($b$,3),3$: $($c$,1),4$: $($a$,1),5$: $($b$,1),6$: $($d$,2),7$: $($b$,1),8$: $($d$,1),9$: $($c$,3),10$: $($c$,3),11$: $($c$,1),12$: $($d$,1).$ Assuming the initial value of all the actions are the same as the last digit of your student id divided by $2,$ please provide answers to the following questions in this specific context.