for a markov chain with transition probabilities Pij, considering the period d for some state i apparently it can be shown that for some N, Piind>0 for all n≥N. can someone prove this for me?
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.