Answered step by step
Verified Expert Solution
Question
1 Approved Answer
b) Consider a symmetric random walk on the integers {0, +1, 12, ...}. This Markov chain is a sequence {X } where {Xn+1 = Xn
b) Consider a symmetric random walk on the integers {0, +1, 12, ...}. This Markov chain is a sequence {X } where {Xn+1 = Xn + 1} = p, P{Xn+1 = Xn -1} = q, where p + q = 1. Suppose the chain starts at the origin Xo = 0. i) Derive the probability P(X2n = 0}. ii) Using the Stirling formula n! ~ Vann (2)" , determine whether the origin is a recurrent or transient state. Hint: Being recurrent requires _n P(X2n = 0} = co, while being transient requires En P(Xzn = 0}
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started