Abstract:Many natural Markov chains fail to mix to their stationary distribution in polynomially many steps. Often, this slow mixing is inevitable since it is computationally intractable to sample from their stationary measure. Nevertheless, Markov chains can be shown to always converge quickly to measures that are locally stationary, i.e., measures that don't change over a small number of steps. These locally stationary measures are analogous to local minima in continuous optimization, while stationary measures correspond to global minima. While locally stationary measures can be statistically far from stationary measures, do they enjoy provable theoretical guarantees that have algorithmic implications? We study this question in this work and demonstrate three algorithmic applications of locally stationary measures: 1. We show that Glauber dynamics on the hardcore model can be used to find independent sets of size $\Omega\left(\frac{\log d}{d} \cdot n\right)$ in triangle-free graphs of degree at most $d$. 2. Let $W$ be a symmetric real matrix with bounded spectral diameter and $v$ be a unit vector. Given the matrix $M = \lambda vv^\top + W$ with a planted rank-one spike along vector $v$, for sufficiently large constant $\lambda$, Glauber dynamics on the Ising model defined by $M$ samples vectors $x \in \{\pm 1\}^n$ that have constant correlation with the vector $v$. 3. Let $M = A_{\mathbf{G}} - \frac{d}{n}\mathbf{1}\mathbf{1}^\top$ be a centered version of the adjacency matrix where the graph $\mathbf{G}$ is drawn from a sparse 2-community stochastic block model. We show that for sufficiently large constant signal-to-noise ratio, Glauber dynamics on the Ising model defined by $M$ samples vectors $x \in \{\pm 1\}^n$ that have constant correlation with the hidden community vector $\mathbf{\sigma}$.

Markov chains and mappings of distributions on compact spaces II: Numerics and Conjectures

Markov chains and mappings of distributions on compact spaces

Markov chains revisited

Stationary measures of continuous time Markov chains with applications to stochastic reaction networks

Markov chains: Structure and applications

The Markov chain asymptotics of random mapping graphs

Rates of Convergence for Chains of Expansive Markov Operators

Geometry and Duality of Alternating Markov Chains

On a Markov construction of couplings

Markov Chains Approximations of jump-Diffusion Quantum Trajectories

Various proofs of the Fundamental Theorem of Markov Chains

Coupling results and Markovian structures for number representations of continuous random variables

On invariant distributions of Feller Markov chains with applications to dynamical systems with random switching

Statistical Methods in Markov Chains

Interacting Markov chain Monte Carlo methods for solving nonlinear measure-valued equations

Some properties of Markov chains on the free group $\mathbb F_2$

Information divergences of Markov chains and their applications

Asymptotics of Markov Kernels and the Tail Chain

Topological dynamics of Markov multi-maps of the interval

Hopf algebras and Markov chains: two examples and a theory

Locally Stationary Distributions: A Framework for Analyzing Slow-Mixing Markov Chains