Abstract:Estimating free energy is a fundamental problem in statistical mechanics. Recently, machine-learning-based methods, particularly the variational autoregressive networks (VANs), have been proposed to minimize variational free energy and to approximate the Boltzmann distribution. VAN enjoys notable advantages, including exact computation of the normalized joint distribution and fast unbiased sampling, which are critical features often missing in Markov chain Monte Carlo algorithms. However, VAN also faces significant computational challenges. These include difficulties in the optimization of variational free energy in a complicated parameter space and slow convergence of learning. In this work, we introduce an optimization technique based on natural gradients to the VAN framework, namely ng-VAN, to enhance the learning efficiency and accuracy of the conventional VAN. The method has computational complexity cubic in the batch size rather than in the number of model parameters, hence it can be efficiently implemented for a large VAN model. We carried out extensive numerical experiments on the Sherrington-Kirkpatrick model and spin glasses on random graphs and illustrated that compared with the conventional VAN, ng-VAN significantly improves the accuracy in estimating free energy and converges much faster with shorter learning time. This allows extending the VAN framework's applicability to challenging statistical mechanics problems that were previously not accessible.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to efficiently estimate free energy in statistical mechanics. Specifically, variational auto - regressive networks (VANs) are proposed to minimize the variational free energy and approximate the Boltzmann distribution. Although VAN has the significant advantages of exactness in computing the normalized joint distribution and fast unbiased sampling, it faces challenges in optimizing the variational free energy in complex parameter spaces and slow convergence during the learning process. For this reason, this paper introduces an optimization technique based on the natural gradient (ng - VAN) to enhance the learning efficiency and accuracy of traditional VANs. ### Main contributions of the paper 1. **Proposing the ng - VAN framework**: By integrating the natural gradient method into the VAN framework, the learning efficiency and accuracy are significantly improved. 2. **Efficient natural gradient calculation**: A method with a computational complexity of the cube of the batch size instead of the cube of the number of model parameters is proposed, enabling the natural gradient method to be applied to large - scale VAN models. 3. **Experimental verification**: Through extensive numerical experiments on the Sherrington - Kirkpatrick model and the spin - glass model on random graphs, it is proved that ng - VAN has a significant improvement in the accuracy of estimating free energy and the convergence speed compared with traditional VANs. ### Specific problems - **Free energy estimation**: In statistical mechanics, estimating the partition function, statistics, and obtaining unbiased samples from the equilibrium Boltzmann distribution is a fundamental problem. - **Optimization challenges**: VAN encounters difficulties when optimizing the variational free energy in complex parameter spaces, and the convergence speed during the learning process is slow. - **Computational efficiency**: The traditional natural gradient method has high computational complexity and is difficult to be applied to large - scale models. ### Solutions - **Natural gradient method**: By considering the curvature of the loss function, use a pre - processing matrix to rescale the gradient update, thereby finding the steepest descent direction in the model distribution space. - **Efficient algorithm**: Utilize linear algebra identities to reduce the computational complexity from \(O(N_p^3)\) to \(O(N_b^3+N_p N_b^2)\), where \(N_p\) is the number of parameters and \(N_b\) is the batch size. - **Experimental results**: In multiple benchmark tests, ng - VAN shows a faster convergence speed and higher estimation accuracy. ### Conclusion This paper successfully integrates an efficient natural gradient calculation method into the VAN framework, significantly improving the learning efficiency and accuracy. Although the natural gradient method requires additional computational cost, its advantages in accelerating the convergence speed and improving the estimation accuracy make it have important application prospects in dealing with complex statistical mechanics problems.

Efficient Optimization of Variational Autoregressive Networks with Natural Gradient

Variational neural annealing

Statistical Mechanics Calculations Using Variational Autoregressive Networks and Quantum Annealing

Solving Statistical Mechanics on Sparse Graphs with Feedback Set Variational Autoregressive Networks

Variance extrapolation method for neural-network variational Monte Carlo

Natural Gradient Hybrid Variational Inference with Application to Deep Mixed Models

An Energy-Based Self-Adaptive Learning Rate for Stochastic Gradient Descent: Enhancing Unconstrained Optimization with VAV method

Variational Adaptive-Newton Method for Explorative Learning

Understanding Stochastic Natural Gradient Variational Inference

Variational Optimization for Quantum Problems using Deep Generative Networks

Provable Convergence of Variational Monte Carlo Methods

Variational Autoencoders for Efficient Simulation-Based Inference

A computational framework for neural network-based variational Monte Carlo with Forward Laplacian

Non-convex Bayesian Learning via Stochastic Gradient Markov Chain Monte Carlo

A method for quantifying the generalization capabilities of generative models for solving Ising models

Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm

Optimizing Variational Physics-Informed Neural Networks Using Least Squares

Message passing variational autoregressive network for solving intractable Ising models

Hidden Talents of the Variational Autoencoder

Learning Multi-layer Latent Variable Model via Variational Optimization of Short Run MCMC for Approximate Inference