Hello, I need help

Consider the following example when answering {e)(e). You want to buy a plane ticket to California and you will denitely buy a ticket this week. Each morning, you have to choose whether you will buy the ticket that day or not (day t = 1,21 3, ..., 7). The price of the ticket is either $50, $150, or $200 and you see this price online in the morning before you decide. 1f the ticket costs $200 on day i, then it will cost $200 on day i + 1 with probability 0.5, it will cost $150 on day 1' + 1 with probability 0.45, and it will cost $50 on day i + 1 with probability 3:. Today (this morning, = 1), you know the ticket price is $200. Your objective is to minimize your total expected cost and there is a terminal penalty cost of 35m for not buying your ticket before day t =: 8. Using this information, please complete {c)(e). (c) (2 points) What is the missing value of 3:? i. 0.01 ii. 0.05 iii. 0.15 iv. 0.25 (d) (2 points) What best denes the states of the MDP? i. Let 8.: E S denote the purchase decision on day t ii. Let .9; 65 S denote the current day in the planning horizon iii. Let s; E S denote the cost of the ticket on day t (e) (2 points) Which day corresponds to the terminal epoch? l. t = 1 ii. t = 4 iii. t = 8