Devise an example of a Markov chain with two absorbing states 1,2 and three transient states (3,4,5)
Question:
Devise an example of a Markov chain with two absorbing states 1,2 and three transient states \(3,4,5\) in which the transient states have self-loops, and the probability that, starting from each transient state, the chain is eventually absorbed in state 1 is \(1 / 2\) and the probability that it is eventually absorbed in state 2 is also \(1 / 2\).
Fantastic news! We've Found the answer you've been seeking!
Step by Step Answer:
Related Book For
Introduction To The Mathematics Of Operations Research With Mathematica
ISBN: 9781574446128
1st Edition
Authors: Kevin J Hastings
Question Posted: