Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

3. Suppose that {Xx}so is a MC with state space S = {1, 2,3} and transition matrix: 1 0 0 P 1/4 1/2 1/4 .

image text in transcribed
3. Suppose that {Xx}so is a MC with state space S = {1, 2,3} and transition matrix: 1 0 0 P 1/4 1/2 1/4 . 0 0 (a) Calculate Pij' p") for all n > 1 and i, j = 1, 2,3, and hence write down p(") and (b) Find the limitation of P" as n - co. Does the chain have a limit distribution? (c) Show that this MC has more than one stationary distributions. (d) Assuming Xo = 2, find the probability that the chain gets absorbed in 1. (e) Assuming Xo = 2, find the expected time (number of steps) until the chain gets absorbed in 1 or 3. More specifically, let T be the absorption time, i.e., the first time the chain visits a state in 1 or 3. We would like to find E[T| Xo = 2]

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access with AI-Powered Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Labor and Employment Law Text and Cases

Authors: David Twomey

15th edition

1133188281, 978-1133711841, 1133711847, 978-1285247632, 978-1133188285

Students also viewed these Mathematics questions

Question

What is included in an Amazon Machine Image ( AMI ) ?

Answered: 1 week ago