Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Consider the inhomogeneous time Markov chain (Xn) on Z which at step k has the following rule. If at 0, it transitions to { 1,

image text in transcribed
Consider the inhomogeneous time Markov chain (Xn) on Z which at step k has the following rule. If at 0, it transitions to { 1, 1} with probability 1/(2k) respectively, or otherwise stays at 0. If at x 7E 0, it transitions to 2x with probability 1/2 and to 0 with probability 1/2. Show the following. . Suppose that n, m E N, show that almost surely lim lim inf Pr(X,,+,,, = 0| X,) = 1 \"Tl>00 iii>00 Hint: Break this into cases, according to value of X n, and then give lower bounds for the probability in terms of m and n. The memoryless property of the geometric random variable is helpful. - Using the bound above, show that limn.H30 Pr(X,, = 0) = 1. . Show by Better BorelCantelli that for some m E N sufficiently large, ka q 0 for infinitely many k, almost surely (and hence -I(X,, 2) 0))

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image_2

Step: 3

blur-text-image_3

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Transportation A Global Supply Chain Perspective

Authors: John J. Coyle, Robert A. Novak, Brian Gibson, Edward J. Bard

8th edition

9781305445352, 1133592961, 130544535X, 978-1133592969

More Books

Students also viewed these Mathematics questions