Answered step by step
Verified Expert Solution
Question
1 Approved Answer
3. Suppose that {Xx}so is a MC with state space S = {1, 2,3} and transition matrix: 1 0 0 P 1/4 1/2 1/4 .
3. Suppose that {Xx}so is a MC with state space S = {1, 2,3} and transition matrix: 1 0 0 P 1/4 1/2 1/4 . 0 0 (a) Calculate Pij' p") for all n > 1 and i, j = 1, 2,3, and hence write down p(") and (b) Find the limitation of P" as n - co. Does the chain have a limit distribution? (c) Show that this MC has more than one stationary distributions. (d) Assuming Xo = 2, find the probability that the chain gets absorbed in 1. (e) Assuming Xo = 2, find the expected time (number of steps) until the chain gets absorbed in 1 or 3. More specifically, let T be the absorption time, i.e., the first time the chain visits a state in 1 or 3. We would like to find E[T| Xo = 2]
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access with AI-Powered Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started