Abstract:Stochastic sampling algorithms such as Langevin Monte Carlo are inspired by physical systems in a heat bath. Their equilibrium distribution is the canonical ensemble given by a prescribed target distribution, so they must balance fluctuation and dissipation as dictated by the fluctuation-dissipation theorem. In contrast to the common belief, we show that the fluctuation-dissipation theorem is not required because only the configuration space distribution, and not the full phase space distribution, needs to be canonical. We propose a continuous-time Microcanonical Langevin Monte Carlo (MCLMC) as a dissipation-free system of stochastic differential equations (SDE). We derive the corresponding Fokker-Planck equation and show that the stationary distribution is the microcanonical ensemble with the desired canonical distribution on configuration space. We prove that MCLMC is ergodic for any nonzero amount of stochasticity, and for smooth, convex potentials, the expectation values converge exponentially fast. Furthermore, the deterministic drift and the stochastic diffusion separately preserve the stationary distribution. This uncommon property is attractive for practical implementations as it implies that the drift-diffusion discretization schemes are bias-free, so the only source of bias is the discretization of the deterministic dynamics. We applied MCLMC on a lattice $\phi^4$ model, where Hamiltonian Monte Carlo (HMC) is currently the state-of-the-art integrator. For the same accuracy, MCLMC converges 12 times faster than HMC on an $8\times8$ lattice. On a $64\times64$ lattice, it is already 32 times faster. The trend is expected to persist to larger lattices, which are of particular interest, for example, in lattice quantum chromodynamics.

Combinatorial Dehn surgery on cubed and Haken 3-manifolds

PDMP characterisation of event-chain Monte Carlo algorithms for particle systems

Numerical and Monte Carlo Bethe Ansatz Method: 1d Heisenberg Model

Nonequilibrium candidate Monte Carlo: A new tool for efficient equilibrium simulation

Geometric allocation approaches in Markov chain Monte Carlo

On the Mathematical foundations of Diffusion Monte Carlo

Geometric ergodicity of trans-dimensional Markov chain Monte Carlo algorithms

A path integral methodology for obtaining thermodynamic properties of nonadiabatic systems using Gaussian mixture distributions

Ergodic observables in non-ergodic systems: the example of the harmonic chain

Overcoming Ergodicity Problems of the Hybrid Monte Carlo Method using Radial Updates

Phase changes in 38 atom Lennard-Jones clusters. II: A parallel tempering study of equilibrium and dynamic properties in the molecular dynamics and microcanonical

Anomalous diffusion in convergence to effective ergodicity

Monte Carlo and kinetic Monte Carlo methods

A single-walker approach for studying quasi-ergodic systems

Systematic characterization of thermodynamic and dynamical phase behavior in systems with short-ranged attraction

Fluctuation without dissipation: Microcanonical Langevin Monte Carlo

The off-equilibrium Kinetic Ising model: The Metric Case

Generalized Metropolis dynamics with a generalized master equation: An approach for time-independent and time-dependent Monte Carlo simulations of generalized spin systems

Applications of the Monte Carlo Method in Statistical Physics

Fluctuations of Interacting Markov Chain Monte Carlo Methods

A hypocoercivity related ergodicity method with rate of convergence for singularly distorted degenerate Kolmogorov equations and applications