On the $α$-lazy version of Markov chains in estimation and testing problems

Sela Fried,Geoffrey Wolfer

DOI: https://doi.org/10.48550/arXiv.2105.09536

IF: 5.414

2021-05-20

Machine Learning

Abstract:Given access to a single long trajectory generated by an unknown irreducible Markov chain $M$, we simulate an $\alpha$-lazy version of $M$ which is ergodic. This enables us to generalize recent results on estimation and identity testing that were stated for ergodic Markov chains in a way that allows fully empirical inference. In particular, our approach shows that the pseudo spectral gap introduced by Paulin [2015] and defined for ergodic Markov chains may be given a meaning already in the case of irreducible but possibly periodic Markov chains.