Abstract:Many natural Markov chains fail to mix to their stationary distribution in polynomially many steps. Often, this slow mixing is inevitable since it is computationally intractable to sample from their stationary measure. Nevertheless, Markov chains can be shown to always converge quickly to measures that are locally stationary, i.e., measures that don't change over a small number of steps. These locally stationary measures are analogous to local minima in continuous optimization, while stationary measures correspond to global minima. While locally stationary measures can be statistically far from stationary measures, do they enjoy provable theoretical guarantees that have algorithmic implications? We study this question in this work and demonstrate three algorithmic applications of locally stationary measures: 1. We show that Glauber dynamics on the hardcore model can be used to find independent sets of size $\Omega\left(\frac{\log d}{d} \cdot n\right)$ in triangle-free graphs of degree at most $d$. 2. Let $W$ be a symmetric real matrix with bounded spectral diameter and $v$ be a unit vector. Given the matrix $M = \lambda vv^\top + W$ with a planted rank-one spike along vector $v$, for sufficiently large constant $\lambda$, Glauber dynamics on the Ising model defined by $M$ samples vectors $x \in \{\pm 1\}^n$ that have constant correlation with the vector $v$. 3. Let $M = A_{\mathbf{G}} - \frac{d}{n}\mathbf{1}\mathbf{1}^\top$ be a centered version of the adjacency matrix where the graph $\mathbf{G}$ is drawn from a sparse 2-community stochastic block model. We show that for sufficiently large constant signal-to-noise ratio, Glauber dynamics on the Ising model defined by $M$ samples vectors $x \in \{\pm 1\}^n$ that have constant correlation with the hidden community vector $\mathbf{\sigma}$.

On strong stationary times and approximation of Markov chain hitting times by geometric sums

Strong Approximation for A Class of Stationary Processes

Strong times and first hitting

On geometric-type approximations with applications to risk and related processes

Commuting time geometry of ergodic Markov chains

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

On Hitting Times for General Quantum Markov Processes

On cover times of Markov chains

Quasi-stationary distributions of non-absorbing Markov chains

Strong Approximation Theorems for Geometrically Weighted Random Series and Their Applications

An Explicit Formula of Hitting Times for Random Walks on Graphs

Velocity formulae between entropy and hitting time for Markov chains

Strong stationary times for features of random walks

Mean hitting times of quantum Markov chains in terms of generalized inverses

Probabilistic limit behaviors of numerical discretizations for time-homogeneous Markov processes

Hitting time statistics for observations of dynamical systems

Elementary Bounds On Mixing Times for Decomposable Markov Chains

Computing hitting times via fluid approximation: application to the coupon collector problem

Locally Stationary Distributions: A Framework for Analyzing Slow-Mixing Markov Chains

Limit Theorems for quadratic forms of Markov Chains

Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains