Abstract:We address the problem of estimating the mixing time $t_{\mathsf{mix}}$ of an arbitrary ergodic finite-state Markov chain from a single trajectory of length $m$. The reversible case was addressed by Hsu et al. [2019], who left the general case as an open problem. In the reversible case, the analysis is greatly facilitated by the fact that the Markov operator is self-adjoint, and Weyl's inequality allows for a dimension-free perturbation analysis of the empirical eigenvalues. As Hsu et al. point out, in the absence of reversibility (which induces asymmetric pair probabilities matrices), the existing perturbation analysis has a worst-case exponential dependence on the number of states $d$. Furthermore, even if an eigenvalue perturbation analysis with better dependence on $d$ were available, in the non-reversible case the connection between the spectral gap and the mixing time is not nearly as straightforward as in the reversible case. Our key insight is to estimate the pseudo-spectral gap $\gamma_{\mathsf{ps}}$ instead, which allows us to overcome the loss of symmetry and to achieve a polynomial dependence on the minimal stationary probability $\pi_\star$ and $\gamma_{\mathsf{ps}}$. Additionally, in the reversible case, we obtain simultaneous nearly (up to logarithmic factors) minimax rates in $t_{\mathsf{mix}}$ and precision $\varepsilon$, closing a gap in Hsu et al., who treated $\varepsilon$ as constant in the lower bounds. Finally, we construct fully empirical confidence intervals for $\gamma_{\mathsf{ps}}$, which shrink to zero at a rate of roughly $1/\sqrt{m}$, and improve the state of the art in even the reversible case.

Bounds on Mixing Time for Time-Inhomogeneous Markov Chains

Estimating the Mixing Time of Ergodic Markov Chains

Mixing Time for the Ising Model and Random Walks

Geometric bounds on the fastest mixing Markov chain

Elementary Bounds On Mixing Times for Decomposable Markov Chains

Empirical and Instance-Dependent Estimation of Markov Chain and Mixing Time

Random Walks on Dynamical Random Environments with Non-Uniform Mixing

Mixing of fast random walks on dynamic random permutations

Speeding up random walk mixing by starting from a uniform vertex

Intersection and mixing times for reversible chains

Bounds on Lifting Continuous Markov Chains to Speed Up Mixing

Rapid mixing for the hardcore Glauber dynamics and other Markov chains in bounded-treewidth graphs

Mixing time of random walk on dynamical random cluster

Sensitivity of mixing times

Mixing Time of Near-Critical Random Graphs

The Distribution of Mixing Times in Markov Chains

Cutoff for mixtures of permuted Markov chains: reversible case

Mixing time of the Chung--Diaconis--Graham random process

For every quantum walk there is a (classical) lifted Markov chain with faster mixing time

Strong stationary times for features of random walks

Optimistic Estimation of Convergence in Markov Chains with the Average-Mixing Time