An informal introduction to the Parisi formula

Jean-Christophe Mourrat

2024-10-16

Abstract:This note is an informal presentation of spin glasses and of the Parisi formula. We also discuss some models for which the Parisi formula is not well-understood, and some partial progress that relies upon a connection with partial differential equations.

Probability,Disordered Systems and Neural Networks,Mathematical Physics

What problem does this paper attempt to address?

A Parisi Formula for Quantum Spin Glasses

Chokri Manai,Simone Warzel

2024-03-10

Abstract:We establish three equivalent versions of a Parisi formula for the free energy of mean-field spin glasses in a transversal magnetic field. These results are derived from available results for classical vector spin glasses by an approximation method using the functional integral representation of the partition function. In this approach, the order parameter is a non-decreasing function with values in the non-negative, real hermitian Hilbert-Schmidt operators. For the quantum Sherrington-Kirkpatrick model, we also show that under the assumption of self-averaging of the self-overlap, the optimising Parisi order parameter is found within a two-dimensional subspace spanned by the self-overlap and the fully stationary overlap.

Disordered Systems and Neural Networks,Statistical Mechanics,Mathematical Physics
Un-inverting the Parisi formula

Jean-Christophe Mourrat

2023-09-05

Abstract:The free energy of any system can be written as the supremum of a functional involving an energy term and an entropy term. Surprisingly, the limit free energy of mean-field spin glasses is expressed as an infimum instead, a phenomenon sometimes called an inverted variational principle. Using a stochastic-control representation of the Parisi functional and convex duality arguments, we rewrite this limit free energy as a supremum over martingales in a Wiener space.

Probability,Disordered Systems and Neural Networks
Parisi Formula for Balanced Potts Spin Glass

Erik Bates,Youngtak Sohn

DOI: https://doi.org/10.1007/s00220-024-05100-9

IF: 2.361

2024-09-15

Communications in Mathematical Physics

Abstract:The Potts spin glass is a generalization of the Sherrington–Kirkpatrick (SK) model that allows for spins to take more than two values. Based on a novel synchronization mechanism, Panchenko (Ann Probab 46(2):829–864, 2018) showed that the limiting free energy is given by a Parisi-type variational formula. The functional order parameter in this formula is a probability measure on a monotone path in the space of positive-semidefinite matrices. By comparison, the order parameter for the SK model is much simpler: a probability measure on the unit interval. Nevertheless, a longstanding prediction by Elderfield and Sherrington (J Phys C Solid State Phys 16(15):L497–L503, 1983) is that the order parameter for the Potts spin glass can be reduced to that of the SK model. We prove this prediction for the balanced Potts spin glass, where the model is constrained so that the fraction of spins taking each value is asymptotically the same. It is generally believed that the limiting free energy of the balanced model is the same as that of the unconstrained model, in which case our results reduce the functional order parameter of Panchenko's variational formula to probability measures on the unit interval. The intuitive reason—for both this belief and the Elderfield–Sherrington prediction—is that no spin value is a priori preferred over another, and the order parameter should reflect this inherent symmetry. This paper rigorously demonstrates how symmetry, when combined with synchronization, acts as the desired reduction mechanism. Our proof requires that we introduce a generalized Potts spin glass model with mixed higher-order interactions, which is interesting it its own right. We prove that the Parisi formula for this model is differentiable with respect to inverse temperatures. This is a key ingredient for guaranteeing the Ghirlanda–Guerra identities without perturbation, which then allow us to exploit symmetry and synchronization simultaneously.

physics, mathematical
On Parisi measures of Potts spin glasses with correction

Hong-Bin Chen

2023-12-26

Abstract:In the Potts spin glass model, inspired by the symmetry argument in [<a class="link-https" data-arxiv-id="2310.06745" href="https://arxiv.org/abs/2310.06745">arXiv:2310.06745</a>] for the constrained free energy, we study the free energy with self-overlap correction. Similarly, we simplify the Parisi-type formula, originally an infimum over matrix-valued paths, into an optimization over real-valued paths, which can be interpreted as quantile functions of probability measures on the unit interval. Minimizers are usually called Parisi measures. Using results in [<a class="link-https" data-arxiv-id="2311.10446" href="https://arxiv.org/abs/2311.10446">arXiv:2311.10446</a>] generalizing the Auffinger-Chen convexity argument, we deduce the uniqueness of the Parisi measure. The approach in [<a class="link-https" data-arxiv-id="2310.06745" href="https://arxiv.org/abs/2310.06745">arXiv:2310.06745</a>] is to perturb the covariance function of the Hamiltonian into one associated with the generic model, prove the results there, and then reduce the perturbation. Here, we choose to perturb the model by adding an external field parametrized by Ruelle probability cascades. This is used in the Hamilton-Jacobi equation approach and we directly apply results in [<a class="link-https" data-arxiv-id="2311.08980" href="https://arxiv.org/abs/2311.08980">arXiv:2311.08980</a>].

Probability,Disordered Systems and Neural Networks
A Hopf-like formula for mean-field spin glass models

Victor Issa

2024-10-11

Abstract:We study mean-field spin glass models with general vector spins and convex covariance function. For those models, it is known that the limit of the free energy can be written as the supremum of a functional, this is the celebrated Parisi formula. In this paper, we observe that the Parisi functional extends into a concave and Lipschitz functional on the set of signed measures. We use this fact and Fenchel-Moreau duality to derive an un-inverted version of the Parisi formula. Namely, we show that the limit of the free energy can be written as the infimum of a functional related to the Parisi functional. This un-inverted formula can be interpreted as a Hopf-like formula for some Hamilton-Jacobi equation in Wasserstein space.

Probability
Parisi PDE and convexity for vector spins

Hong-Bin Chen

2023-12-25

Abstract:We consider mean-field vector spin glasses with self-overlap correction. The limit of free energy is known to be the Parisi formula, which is an infimum over matrix-valued paths. We decompose such a path into a Lipschitz matrix-valued path and the quantile function of a one-dimensional probability measure. For such a pair, we associate a Parisi PDE generalized for vector spins. Under mild conditions, we rewrite the Parisi formula in terms of solutions of the PDE. Moreover, for each fixed Lipschitz path, the Parisi functional is strictly convex over probability measures.

Probability,Disordered Systems and Neural Networks,Analysis of PDEs
The Crisanti-Sommers Formula for Spherical Spin Glasses with Vector Spins

Justin Ko

DOI: https://doi.org/10.48550/arXiv.1911.04355

2019-11-11

Abstract:We obtain the analogue of the Crisanti-Sommers variational formula for spherical spin glasses with vector spins. This formula is derived from the discrete Parisi variational formula for the limit of the free energy of constrained copies of spherical spin glasses. In vector spin models, the variations of the functional order parameters must preserve the monotonicity of matrix paths which introduces a new challenge in contrast to the derivation of the classical Crisanti-Sommers formula.

Probability
A Constructive Proof of the Spherical Parisi Formula

Brice Huang,Mark Sellke

2024-05-02

Abstract:The Parisi formula for the free energy is among the crown jewels in the theory of spin glasses. We present a simpler proof of the lower bound in the case of the spherical mean-field model. Our method follows the TAP approach developed recently in e.g. (Subag, 2018): we obtain an ultrametric tree of pure states, each with approximately the same free energy as the entire model, which are hierarchically arranged in accordance with the Parisi ansatz. We construct this tree ``layer by layer'' given the minimizer to Parisi's variational problem. On overlap intervals with full RSB, the tree is built by an optimization algorithm due to Subag. On overlap intervals with finite RSB, the tree is constructed by a new truncated second moment argument; a similar argument also characterizes the free energy of the resulting pure states. Notably we do not use the Aizenman--Sims--Starr scheme, and require interpolation bounds only up to the 1RSB level. Our methods also yield results for large deviations of the ground state, including the entire upper tail rate function for all 1RSB models without external field.

Probability,Disordered Systems and Neural Networks,Mathematical Physics
Existence and Uniqueness of Permutation-Invariant Optimizers for Parisi Formula

Victor Issa

2024-07-19

Abstract:It has recently been shown in [<a class="link-https" data-arxiv-id="2310.06745" href="https://arxiv.org/abs/2310.06745">arXiv:2310.06745</a>] that, upon constraining the system to stay in a balanced state, the Parisi formula for the mean-field Potts model can be written as an optimization problem over permutation-invariant functional order parameters. In this paper, we focus on permutation-invariant mean-field spin glass models. After introducing a correction term in the definition of the free energy and without constraining the system, we show that the limit free energy can be written as an optimization problem over permutation-invariant functional order parameters. We also show that for some models this optimization problem admits a unique optimizer. In the case of Ising spins, the correction term can be easily removed, and those results transfer to the uncorrected limit free energy. We also derive an upper bound for the limit free energy of some nonconvex permutation-invariant models. This upper bound is expressed as a variational formula and is related to the solution of some Hamilton-Jacobi equation. We show that if no first order phase transition occurs, then this upper bound is equal to the lower bound derived in [<a class="link-https" data-arxiv-id="2010.09114" href="https://arxiv.org/abs/2010.09114">arXiv:2010.09114</a>]. We expect that this hypothesis holds at least in the high temperature regime. Our method relies on the fact that the free energy of any convex mean-field spin glass model can be interpreted as the strong solution of some Hamilton-Jacobi equation.

Probability
On spin distributions for generic p-spin models

Antonio Auffinger,Aukosh Jagannath

DOI: https://doi.org/10.1007/s10955-018-2188-5

2018-02-21

Abstract:We provide an alternative formula for spin distributions of generic p-spin glass models. As a main application of this expression, we write spin statistics as solutions of partial differential equations and we show that the generic p-spin models satisfy multiscale Thouless-Anderson-Palmer equations as originally predicted in the work of Mezard-Virasoro.

Probability,Mathematical Physics
Free energy in multi-species mixed $p$-spin spherical models

Erik Bates,Youngtak Sohn

DOI: https://doi.org/10.1214/22-EJP780

2023-11-27

Abstract:We prove a Parisi formula for the limiting free energy of multi-species spherical spin glasses with mixed $p$-spin interactions. The upper bound involves a Guerra-style interpolation and requires a convexity assumption on the model's covariance function. Meanwhile, the lower bound adapts the cavity method of Chen so that it can be combined with the synchronization technique of Panchenko; this part requires no convexity assumption. In order to guarantee that the resulting Parisi formula has a minimizer, we formalize the pairing of synchronization maps with overlap measures so that the constraint set is a compact metric space. This space is not related to the model's spherical structure and can be carried over to other multi-species settings.

Probability,Disordered Systems and Neural Networks,Mathematical Physics
Self-overlap correction simplifies the Parisi formula for vector spins

Hong-Bin Chen

2023-11-17

Abstract:We propose a simpler approach to identifying the limit of free energy in a vector spin glass model by adding a self-overlap correction to the Hamiltonian. This avoids constraining the self-overlap and allows us to identify the limit with the classical Parisi formula, similar to the proof for scalar models with Ising spins. For the upper bound, the correction cancels self-overlap terms in Guerra's interpolation. For the lower bound, we add an extra perturbation term to make the self-overlap concentrate, a technique already used in [Probab. Math. Phys., 2(2):281-339, Ann. Inst. Henri Poincaré Probab. Stat., 59(3):1143-1182] to ensure the Ghirlanda-Guerra identities. We then remove the correction using a Hamilton-Jacobi equation technique, which yields a formula similar to that in [Ann. Probab., 46(2):865-896]. Additionally, we sketch a direct proof of the main result in [Electron. J. Probab. 25(23):1-17].

Probability,Disordered Systems and Neural Networks
An Introduction to the Theory of Spin Glasses

Ada Altieri,Marco Baity-Jesi

DOI: https://doi.org/10.1016/B978-0-323-90800-9.00249-3

2023-02-10

Abstract:We review the main methods used to study spin glasses. In the first part, we focus on methods for fully connected models and systems defined on a tree, such as the replica method, the Thouless-Anderson-Palmer formalism, the cavity method, and the dynamical mean-field theory. In the second part, we deal with the description of low-dimensional systems, mostly in three spatial dimensions, which are mostly studied through numerical simulations. We conclude by mentioning some of the main open problems in the field.

Disordered Systems and Neural Networks,Statistical Mechanics
The Marginally Stable Bethe Lattice Spin Glass Revisited

Giorgio Parisi

DOI: https://doi.org/10.1007/s10955-017-1724-z

2017-02-07

Journal of Statistical Physics

Abstract:Bethe lattice spins glasses are supposed to be marginally stable, i.e. their equilibrium probability distribution changes discontinuously when we add an external perturbation. So far the problem of a spin glass on a Bethe lattice has been studied only using an approximation where marginal stability is not present, which is wrong in the spin glass phase. Because of some technical difficulties, attempts at deriving a marginally stable solution have been confined to some perturbative regimes, high connectivity lattices or temperature close to the critical temperature. Using the cavity method, we propose a general non-perturbative approach to the Bethe lattice spin glass problem using approximations that should be hopefully consistent with marginal stability.

physics, mathematical
Real Spin Glasses Relax Slowly in the Shade of Hierarchical Trees

E. Vincent,J. Hammann,M. Ocio

DOI: https://doi.org/10.1007/s10955-009-9730-4

2009-04-03

Journal of Statistical Physics

Abstract:The Parisi solution of the mean-field spin glass has been widely accepted and celebrated. Its marginal stability in 3d and its complexity however raised the question of its relevance to real spin glasses. This paper gives a short overview of the important experimental results which could be understood within the mean-field solution. The existence of a true phase transition and the particular behaviour of the susceptibility below the freezing temperature, predicted by the theory, are clearly confirmed by the experimental results. The behaviour of the complex order parameter and of the Fluctuation Dissipation ratio are in good agreement with results of spontaneous noise measurements. The very particular ultrametric symmetry, the key feature of the theory, provided us with a simple description of the rejuvenation and memory effects observed in experiment. Finally, going a step beyond mean-field, the paper shortly discusses new analyses in terms of correlated domains characterized by their length scales, as well as new experiments on superspin glasses which compare well with recent theoretical simulations.

physics, mathematical
The p-spin spherical spin glass model

A. Barrat

DOI: https://doi.org/10.48550/arXiv.cond-mat/9701031

1997-01-07

Abstract:This review presents various aspects of a mean-field spin glass model known as the p-spin spherical spin glass model, which has raised a lot of interest in the study of spin glasses, and also for its possible links with a mean-field theory of structural glasses. This preprint contains no new results and is therefore not intended to be published, but its aim is to present a collection of results and formulas concerning this very rich model. It is in fact the english translation of one of the chapters of my PhD thesis (``Quelques aspects de la dynamique hors d'equilibre des verres de spin'', ``Some aspects of the out of equilibrium dynamics of spin glasses''). A postscript version (in french) of this PhD thesis will soon be available at <a class="link-external link-http" href="http://www.lpt.ens.fr" rel="external noopener nofollow">this http URL</a> .

Disordered Systems and Neural Networks
Explicit generation of the branching tree of states in spin glasses

G. Parisi,F. Ricci-Tersenghi,D. Yllanes

DOI: https://doi.org/10.1088/1742-5468/2015/05/P05002

2015-04-02

Abstract:We present a numerical method to generate explicit realizations of the tree of states in mean-field spin glasses. The resulting study illuminates the physical meaning of the full replica symmetry breaking solution and provides detailed information on the structure of the spin-glass phase. A cavity approach ensures that the method is self-consistent and permits the evaluation of sophisticated observables, such as correlation functions. We include an example application to the study of finite-size effects in single-sample overlap probability distributions, a topic that has attracted considerable interest recently.

Disordered Systems and Neural Networks
Spin glasses and Stein's method

Sourav Chatterjee

DOI: https://doi.org/10.48550/arXiv.0706.3500

2009-08-02

Abstract:We introduce some applications of Stein's method in the high temperature analysis of spin glasses. Stein's method allows the direct analysis of the Gibbs measure without having to create a cavity. Another advantage is that it gives limit theorems with total variation error bounds, although the bounds can be suboptimal. A surprising byproduct of our analysis is a relatively transparent explanation of the Thouless-Anderson-Palmer system of equations. Along the way, we develop Stein's method for mixtures of two Gaussian densities.

Probability,Mathematical Physics
Crisanti-Sommers formula and simultaneous symmetry breaking in multi-species spherical spin glasses

Erik Bates,Youngtak Sohn

DOI: https://doi.org/10.1007/s00220-022-04421-x

2023-11-27

Abstract:There is a rich history of expressing the limiting free energy of mean-field spin glasses as a variational formula over probability measures on $[0,1]$, where the measure represents the similarity (or "overlap") of two independently sampled spin configurations. At high temperatures, the formula's minimum is achieved at a measure which is a point mass, meaning sample configurations are asymptotically orthogonal up to a magnetic field correction. At low temperatures, though, a very different behavior emerges known as replica symmetry breaking (RSB). The deep wells in the energy landscape create more rigid structure, and the optimal overlap measure is no longer a point mass. The exact size of its support remains in many cases an open problem. Here we consider these themes for multi-species spherical spin glasses. Following a companion work in which we establish the Parisi variational formula, here we present this formula's Crisanti-Sommers representation. In the process, we gain new access to a problem unique to the multi-species setting. Namely, if RSB occurs for one species, does it necessarily occur for other species as well? We provide sufficient conditions for the answer to be yes. For instance, we show that if two species share any quadratic interaction, then RSB for one implies RSB for the other. Moreover, the level of symmetry breaking must be identical, even in cases of full RSB. In the presence of an external field, any type of interaction suffices.

Mathematical Physics,Disordered Systems and Neural Networks,Probability

An informal introduction to the Parisi formula

A Parisi Formula for Quantum Spin Glasses

Un-inverting the Parisi formula

Parisi Formula for Balanced Potts Spin Glass

On Parisi measures of Potts spin glasses with correction

A Hopf-like formula for mean-field spin glass models

Parisi PDE and convexity for vector spins

The Crisanti-Sommers Formula for Spherical Spin Glasses with Vector Spins

A Constructive Proof of the Spherical Parisi Formula

Existence and Uniqueness of Permutation-Invariant Optimizers for Parisi Formula

On spin distributions for generic p-spin models

Free energy in multi-species mixed $p$-spin spherical models

Self-overlap correction simplifies the Parisi formula for vector spins

An Introduction to the Theory of Spin Glasses

The Marginally Stable Bethe Lattice Spin Glass Revisited

Real Spin Glasses Relax Slowly in the Shade of Hierarchical Trees

The p-spin spherical spin glass model

Explicit generation of the branching tree of states in spin glasses

Spin glasses and Stein's method

Crisanti-Sommers formula and simultaneous symmetry breaking in multi-species spherical spin glasses