Abstract:There has been a recent surge of powerful tools to show rapid mixing of Markov chains, via functional inequalities such as Poincaré inequalities. In many situations, Markov chains fail to mix rapidly from a worst-case initialization, yet are expected to approximately sample from a random initialization. For example, this occurs if the target distribution has metastable states, small clusters accounting for a vanishing fraction of the mass that are essentially disconnected from the bulk of the measure. Under such conditions, a Poincaré inequality cannot hold, necessitating new tools to prove sampling guarantees. We develop a framework to analyze simulated annealing, based on establishing so-called weak Poincaré inequalities. These inequalities imply mixing from a suitably warm start, and simulated annealing provides a way to chain such warm starts together into a sampling algorithm. We further identify a local-to-global principle to prove weak Poincaré inequalities, mirroring the spectral independence and localization schemes frameworks for analyzing mixing times of Markov chains. As our main application, we prove that simulated annealing samples from the Gibbs measure of a spherical spin glass for inverse temperatures up to a natural threshold, matching recent algorithms based on algorithmic stochastic localization. This provides the first Markov chain sampling guarantee that holds beyond the uniqueness threshold for spherical spin glasses, where mixing from a worst-case initialization is provably slow. As an ingredient in our proof, we prove bounds on the operator norm of the covariance matrix of spherical spin glasses in the full replica-symmetric regime. Additionally, we resolve questions related to the mixing of Glauber dynamics in the ferromagnetic Potts model from a uniform monochromatic coloring, and sampling using data-based initializations.

Spin glasses and Stein's method

An Introduction to the Theory of Spin Glasses

Direct sampling of complex landscapes at low temperatures: the three-dimensional +/-J Ising spin glass

Spectral gap estimates for mixed p-spin models at high temperature

Spectral Gap Estimates in Mean Field Spin Glasses

On spin distributions for generic p-spin models

Sampling from Spherical Spin Glasses in Total Variation via Algorithmic Stochastic Localization

Joint parameter estimations for spin glasses

Finite-Dimensional Spin Glasses: States, Excitations, and Interfaces

Hypergraph Counting and Mixed $p$-Spin Glass Models under Replica Symmetry

On Marginal Stability in Low Temperature Spherical Spin Glasses

On sampling diluted Spin Glasses using Glauber dynamics

Explicit generation of the branching tree of states in spin glasses

Local vs. Global Variables for Spin Glasses

The dipolar spin glass transition in three dimensions

Spin glasses and algorithm benchmarks: A one-dimensional view

Spin Glasses: Experimental Signatures and Salient Outcomes

Spin glasses: redux: an updated experimental/materials survey

Weak Poincaré Inequalities, Simulated Annealing, and Sampling from Spherical Spin Glasses

Following States in Temperature in the Spherical S+p-Spin Glass Model

How to compute efficiently the analytical solution to Heisenberg spin glass models on sparse random graphs and their de Almeida-Thouless line