Higher Order Ergodic Markov Chains and First Passage Times

Lixing Han,Kelun Wang,Jianhong Xu
DOI: https://doi.org/10.1080/03081087.2021.1968782
2022-01-01
Abstract:We study the relationship between ergodicity and irreducibility of transition probability tensors. We then introduce the notions of first passage times and mean first passage times, both in the tensor form, for higher order Markov chains and prove some properties of these quantities. Numerical examples are also given to illustrate our results.
What problem does this paper attempt to address?