Abstract:There has been a recent surge of powerful tools to show rapid mixing of Markov chains, via functional inequalities such as Poincaré inequalities. In many situations, Markov chains fail to mix rapidly from a worst-case initialization, yet are expected to approximately sample from a random initialization. For example, this occurs if the target distribution has metastable states, small clusters accounting for a vanishing fraction of the mass that are essentially disconnected from the bulk of the measure. Under such conditions, a Poincaré inequality cannot hold, necessitating new tools to prove sampling guarantees. We develop a framework to analyze simulated annealing, based on establishing so-called weak Poincaré inequalities. These inequalities imply mixing from a suitably warm start, and simulated annealing provides a way to chain such warm starts together into a sampling algorithm. We further identify a local-to-global principle to prove weak Poincaré inequalities, mirroring the spectral independence and localization schemes frameworks for analyzing mixing times of Markov chains. As our main application, we prove that simulated annealing samples from the Gibbs measure of a spherical spin glass for inverse temperatures up to a natural threshold, matching recent algorithms based on algorithmic stochastic localization. This provides the first Markov chain sampling guarantee that holds beyond the uniqueness threshold for spherical spin glasses, where mixing from a worst-case initialization is provably slow. As an ingredient in our proof, we prove bounds on the operator norm of the covariance matrix of spherical spin glasses in the full replica-symmetric regime. Additionally, we resolve questions related to the mixing of Glauber dynamics in the ferromagnetic Potts model from a uniform monochromatic coloring, and sampling using data-based initializations.

Gibbs Sampling, Exponential Families and Orthogonal Polynomials

Compressive Sampling of Polynomial Chaos Expansions: Convergence Analysis and Sampling Strategies

Fast sampling from $β$-ensembles

Nonreversible Langevin Samplers: Splitting Schemes, Analysis and Implementation

Gibbs Sampling of Continuous Potentials on a Quantum Computer

Algebraic signal sampling, Gibbs phenomenon and Prony-type systems

On particle Gibbs sampling

Learning to sample fibers for goodness-of-fit testing

A Langevin-like Sampler for Discrete Distributions

Fast sampling via spectral independence beyond bounded-degree graphs

Sampling and estimation on manifolds using the Langevin diffusion

A Distributed Block-Split Gibbs Sampler with Hypergraph Structure for High-Dimensional Inverse Problems

Sampling from Gaussian Process Posteriors using Stochastic Gradient Descent

Weak Poincaré Inequalities, Simulated Annealing, and Sampling from Spherical Spin Glasses

Sampling from the Sherrington-Kirkpatrick Gibbs measure via algorithmic stochastic localization

Convergence Rate of Gibbs Sampler and Its Application

Stability of Discrete Empirical Interpolation and Gappy Proper Orthogonal Decomposition with Randomized and Deterministic Sampling Points

Convergence Analysis of Ensemble Filters for Linear Stochastic Systems with Poisson-Sampled Observations

Nonparametric estimation of the mixing density using polynomials

Gibbs state sampling via cluster expansions

Sampling Approximately Low-Rank Ising Models: MCMC meets Variational Methods