Abstract:We consider Ising mixed $p$-spin glasses at high-temperature and without external field, and study the problem of sampling from the Gibbs distribution $\mu$ in polynomial time. We develop a new sampling algorithm with complexity of the same order as evaluating the gradient of the Hamiltonian and, in particular, at most linear in the input size. We prove that, at sufficiently high-temperature, it produces samples from a distribution $\mu^{alg}$ which is close in normalized Wasserstein distance to $\mu$. Namely, there exists a coupling of $\mu$ and $\mu^{alg}$ such that if $({\boldsymbol x},{\boldsymbol x}^{alg})\in\{-1,+1\}^n\times \{-1,+1\}^n$ is a pair drawn from this coupling, then $n^{-1}{\mathbb E}\{\|{\boldsymbol x}-{\boldsymbol x}^{alg}\|_2^2\}=o_n(1)$. For the case of the Sherrington-Kirkpatrick model, our algorithm succeeds in the full replica-symmetric phase. We complement this result with a negative one for sampling algorithms satisfying a certain `stability' property, which is verified by many standard techniques. No stable algorithm can approximately sample at temperatures below the onset of shattering, even under the normalized Wasserstein metric. Further, no algorithm can sample at temperatures below the onset of replica symmetry breaking. Our sampling method implements a discretized version of a diffusion process that has become recently popular in machine learning under the name of `denoising diffusion.' We derive the same process from the general construction of stochastic localization. Implementing the diffusion process requires to efficiently approximate the mean of the tilted measure. To this end, we use an approximate message passing algorithm that, as we prove, achieves sufficiently accurate mean estimation.

Exact Algorithm for Sampling the 2D Ising Spin Glass

Large-scale Dynamical Simulations of the Three-Dimensionalxyspin Glass

Direct sampling of complex landscapes at low temperatures: the three-dimensional +/-J Ising spin glass

Physics of the Edwards-Anderson Spin Glass in Dimensions $d=3,\ldots,8$ from Heuristic Ground State Optimization

Efficient Cluster Algorithm for Spin Glasses in Any Space Dimension

Inference algorithm for finite-dimensional spin glasses: belief propagation on the dual lattice

Physics of the Edwards–Anderson spin glass in dimensions d = 3, ... ,8 from heuristic ground state optimization

Efficient generation of series expansions for $\pm J$ Ising spin-glasses in a classical or a quantum (transverse) field

Perfect Sampling in Infinite Spin Systems Via Strong Spatial Mixing

Towards Artificial Ising Spin Glasses: Thermal Ordering in Randomized Arrays of Ising-type Nanomagnets

Computational complexity and simulation of rare events of Ising spin glasses

Three Dimensional Edwards-Anderson Spin Glass Model in an External Field

Sampling from Mean-Field Gibbs Measures via Diffusion Processes

On Computational Complexity of 3D Ising Spin Glass: Lessons from D-Wave Annealer

Spin Glass in the Bond-Diluted J1−J2 Ising Model on the Square Lattice

The ground state energy of the Edwards-Anderson spin glass model with a parallel tempering Monte Carlo algorithm

Dynamics of the Wang–Landau algorithm and complexity of rare events for the three-dimensional bimodal Ising spin glass

Two-dimensional XY spin/gauge glasses on periodic and quasiperiodic lattices

Optimised simulated annealing for Ising spin glasses

Two dimensional Ising spin glasses with non-zero ordering temperatures

A new algorithm for Monte Carlo simulation of Ising spin systems