Abstract:This is a preliminary version. Markov chain Monte Carlo samplers based on discretizations of (overdamped) Langevin dynamics are commonly used in the Bayesian inference and computational statistical physics literature to estimate high-dimensional integrals. One can introduce a non-constant diffusion matrix to precondition these dynamics, and recent works have optimized it in order to sooner reach stationarity by overcoming entropic and energy barriers. However, the methodology introduced to compute these optimal diffusions is not suited to high-dimensional settings, as it relies on costly optimization procedures. In this work, we propose a class of diffusion matrices, based on one-dimensional collective variables (CVs), which helps dynamics explore the latent space defined by the CV. The form of the diffusion matrix is such that the effective dynamics, which are approximations of the processes as observed on the latent space, are governed by the optimal effective diffusion coefficient in a homogenized limit, which possesses an analytical expression. We describe how this class of diffusion matrices can be constructed and learned during the simulation. We provide implementations of the Metropolis--Adjusted Langevin Algorithm and Riemann Manifold (Generalized) Hamiltonian Monte Carlo algorithms, and discuss numerical optimizations in the case when the CV depends only on a few number of components of the position of the system. We illustrate the efficiency gains of using this class of diffusion by computing mean transition durations between two configurations of a dimer in a solvent.

Information-geometric Markov Chain Monte Carlo methods using Diffusions

Geometry and Dynamics for Markov Chain Monte Carlo

Information geometry of Markov Kernels: a survey

Geometric allocation approaches in Markov chain Monte Carlo

Diffusion Geometry

Geometric ergodicity of trans-dimensional Markov chain Monte Carlo algorithms

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Information divergences of Markov chains and their applications

Monte Carlo Information Geometry: The dually flat case

Improving sampling by modifying the effective diffusion

The Convergence of Markov Chain Monte Carlo Methods: From the Metropolis Method to Hamiltonian Monte Carlo

Theory and Algorithms for Diffusion Processes on Riemannian Manifolds

Markov chain Monte Carlo Methods For Lattice Gaussian Sampling:Convergence Analysis and Enhancement

Variational Markov chain Monte Carlo for Bayesian smoothing of non-linear diffusions

Geometric Constraints in Probabilistic Manifolds: A Bridge from Molecular Dynamics to Structured Diffusion Processes

An introduction to the Markov chain Monte Carlo method

An effective introduction to the Markov Chain Monte Carlo method

Geometry in sampling methods: A review on manifold MCMC and particle-based variational inference methods

Efficient Sampling on Riemannian Manifolds via Langevin MCMC

An Introduction to Markov Chain Monte Carlo

Curved Markov Chain Monte Carlo for Network Learning