Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

3. Suppose that {Xx}so is a MC with state space S = {1, 2,3} and transition matrix: 1 0 0 P 1/4 1/2 1/4 .

image text in transcribed
3. Suppose that {Xx}so is a MC with state space S = {1, 2,3} and transition matrix: 1 0 0 P 1/4 1/2 1/4 . 0 0 (a) Calculate Pij' p") for all n > 1 and i, j = 1, 2,3, and hence write down p(") and (b) Find the limitation of P" as n - co. Does the chain have a limit distribution? (c) Show that this MC has more than one stationary distributions. (d) Assuming Xo = 2, find the probability that the chain gets absorbed in 1. (e) Assuming Xo = 2, find the expected time (number of steps) until the chain gets absorbed in 1 or 3. More specifically, let T be the absorption time, i.e., the first time the chain visits a state in 1 or 3. We would like to find E[T| Xo = 2]

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Introductory Algebra

Authors: Alan S Tussy, Rosemary Karr, Marilyn Massey, Diane Koenig, R David Gustafson

5th Edition

1305161866, 9781305161863

More Books

Students also viewed these Mathematics questions

Question

What is included in an Amazon Machine Image ( AMI ) ?

Answered: 1 week ago

Question

5. How can I help others in the network achieve their goals?

Answered: 1 week ago