Abstract:Many natural Markov chains fail to mix to their stationary distribution in polynomially many steps. Often, this slow mixing is inevitable since it is computationally intractable to sample from their stationary measure. Nevertheless, Markov chains can be shown to always converge quickly to measures that are locally stationary, i.e., measures that don't change over a small number of steps. These locally stationary measures are analogous to local minima in continuous optimization, while stationary measures correspond to global minima. While locally stationary measures can be statistically far from stationary measures, do they enjoy provable theoretical guarantees that have algorithmic implications? We study this question in this work and demonstrate three algorithmic applications of locally stationary measures: 1. We show that Glauber dynamics on the hardcore model can be used to find independent sets of size $\Omega\left(\frac{\log d}{d} \cdot n\right)$ in triangle-free graphs of degree at most $d$. 2. Let $W$ be a symmetric real matrix with bounded spectral diameter and $v$ be a unit vector. Given the matrix $M = \lambda vv^\top + W$ with a planted rank-one spike along vector $v$, for sufficiently large constant $\lambda$, Glauber dynamics on the Ising model defined by $M$ samples vectors $x \in \{\pm 1\}^n$ that have constant correlation with the vector $v$. 3. Let $M = A_{\mathbf{G}} - \frac{d}{n}\mathbf{1}\mathbf{1}^\top$ be a centered version of the adjacency matrix where the graph $\mathbf{G}$ is drawn from a sparse 2-community stochastic block model. We show that for sufficiently large constant signal-to-noise ratio, Glauber dynamics on the Ising model defined by $M$ samples vectors $x \in \{\pm 1\}^n$ that have constant correlation with the hidden community vector $\mathbf{\sigma}$.

Analytic-geometric methods for finite Markov chains with applications to quasi-stationarity

Quasi-stationary distributions of non-absorbing Markov chains

Quasi-stationary distributions in reducible state spaces

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

Stationary measures of continuous time Markov chains with applications to stochastic reaction networks

Statistical Methods in Markov Chains

Representation and Characterization of Quasistationary Distributions for Markov Chains

Quantitative contraction rates for Markov chains on general state spaces

Decisive Markov Chains

One-sided Markov additive processes with lattice and non-lattice increments

Stick-Breaking processes, Clumping, and Markov Chain Occupation Laws

On the quasi-ergodicity of absorbing Markov chains with unbounded transition densities, including random logistic maps with escape

Locally Stationary Distributions: A Framework for Analyzing Slow-Mixing Markov Chains

Entropy of absorbed Markov chains

Asymptotic Analysis of Multiscale Markov Chain

Convergence analysis of some multivariate Markov chains using stochastic monotonicity

Quasi-limiting estimates for periodic absorbed Markov chains

Local stationarity and time-inhomogeneous Markov chains

Stationary entrance chains and applications to random walks

Markov chains revisited

Markov Chains Approximations of jump-Diffusion Quantum Trajectories