Abstract:Motivated by the community detection problem in Bayesian inference, as well as the recent explosion of interest in spin glasses from statistical physics, we study the classical Glauber dynamics for sampling from Ising models with sparse random interactions. It is now well-known that when the interaction matrix has spectral diameter less than $1$, Glauber dynamics mixes in $O(n\log n)$ steps. Unfortunately, such criteria fail dramatically for interactions supported on arguably the most well-studied sparse random graph: the Erdős--Rényi random graph $G(n,d/n)$, due to the presence of almost linearly many outlier eigenvalues of unbounded magnitude. We prove that for the \emph{Viana--Bray spin glass}, where the interactions are supported on $G(n,d/n)$ and randomly assigned $\pm\beta$, Glauber dynamics mixes in $n^{1+o(1)}$ time with high probability as long as $\beta \le O(1/\sqrt{d})$, independent of $n$. We further extend our results to random graphs drawn according to the $2$-community stochastic block model, as well as when the interactions are given by a "centered" version of the adjacency matrix. The latter setting is particularly relevant for the inference problem in community detection. Indeed, we use this to show that Glauber dynamics succeeds at recovering communities in the stochastic block model in a companion paper [LMR+24]. The primary technical ingredient in our proof is showing that with high probability, a sparse random graph can be decomposed into two parts -- a \emph{bulk} which behaves like a graph with bounded maximum degree and a well-behaved spectrum, and a \emph{near-forest} with favorable pseudorandom properties. We then use this decomposition to design a localization procedure that interpolates to simpler Ising models supported only on the near-forest, and then execute a pathwise analysis to establish a modified log-Sobolev inequality.

Efficient training of energy-based models via spin-glass control

Self-Supervised Learning of Generative Spin-Glasses with Normalizing Flows

Boosting Monte Carlo simulations of spin glasses using autoregressive neural networks

Demolition and Reinforcement of Memories in Spin-Glass-like Neural Networks

Searching for spin glass ground states through deep reinforcement learning

STANLEY: Stochastic Gradient Anisotropic Langevin Dynamics for Learning Energy-Based Models

Learning Generalized Statistical Mechanics with Matrix Product States

Efficient Training of Energy-Based Models Using Jarzynski Equality

Hyperoptimized approximate contraction of tensor networks for rugged-energy-landscape spin glasses on periodic square and cubic lattices

Conditional Independence of 1D Gibbs States with Applications to Efficient Learning

Neural Networks as Spin Models: From Glass to Hidden Order Through Training

Fast Mixing in Sparse Random Ising Models

Sparse Autoregressive Neural Networks for Classical Spin Systems

Planar Ising-Spin Models in Probabilistic Machine Learning

Learning to find order in disorder

Efficient training of energy-based models using Jarzynski equality *

Inference algorithm for finite-dimensional spin glasses: belief propagation on the dual lattice

Sampling with flows, diffusion, and autoregressive neural networks from a spin-glass perspective

Spin glasses and algorithm benchmarks: A one-dimensional view

Efficient Cluster Algorithm for Spin Glasses in Any Space Dimension

How to compute efficiently the analytical solution to Heisenberg spin glass models on sparse random graphs and their de Almeida-Thouless line