Abstract:Sampling from a target distribution is a fundamental problem. Traditional Markov chain Monte Carlo (MCMC) algorithms, such as the unadjusted Langevin algorithm (ULA), derived from the overdamped Langevin dynamics, have been extensively studied. From an optimization perspective, the Kolmogorov forward equation of the overdamped Langevin dynamics can be treated as the gradient flow of the relative entropy in the space of probability densities embedded with Wassrstein-2 metrics. Several efforts have also been devoted to including momentum-based methods, such as underdamped Langevin dynamics for faster convergence of sampling algorithms. Recent advances in optimizations have demonstrated the effectiveness of primal-dual damping and Hessian-driven damping dynamics for achieving faster convergence in solving optimization problems. Motivated by these developments, we introduce a class of stochastic differential equations (SDEs) called gradient-adjusted underdamped Langevin dynamics (GAUL), which add stochastic perturbations in primal-dual damping dynamics and Hessian-driven damping dynamics from optimization. We prove that GAUL admits the correct stationary distribution, whose marginal is the target distribution. The proposed method outperforms overdamped and underdamped Langevin dynamics regarding convergence speed in the total variation distance for Gaussian target distributions. Moreover, using the Euler-Maruyama discretization, we show that the mixing time towards a biased target distribution only depends on the square root of the condition number of the target covariance matrix. Numerical experiments for non-Gaussian target distributions, such as Bayesian regression problems and Bayesian neural networks, further illustrate the advantages of our approach.

Mean-field underdamped Langevin dynamics and its spacetime discretization

Symmetric Mean-field Langevin Dynamics for Distributional Minimax Problems

Improved Particle Approximation Error for Mean Field Neural Networks

Accelerated convergence to equilibrium and reduced asymptotic variance for Langevin dynamics using Stratonovich perturbations

Uniform-in-time propagation of chaos for kinetic mean field Langevin dynamics

Sampling from the Mean-Field Stationary Distribution

Function approximation by neural nets in the mean-field regime: Entropic regularization and controlled McKean-Vlasov dynamics

Approach to Solving Spin-Boson Dynamics Via Non-Markovian Quantum Trajectories

Mean-Field Langevin Dynamics for Signed Measures via a Bilevel Approach

Numerical Approximation and Fast Evaluation of the Overdamped Generalized Langevin Equation with Fractional Noise

The Poisson Midpoint Method for Langevin Dynamics: Provably Efficient Discretization for Diffusion Models

Gradient-adjusted underdamped Langevin dynamics for sampling

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

Mean-field Langevin System, Optimal Control and Deep Neural Networks

Rigorous dynamical mean field theory for stochastic gradient descent methods

Quantum Langevin Dynamics for Optimization

Improved weak convergence for the long time simulation of Mean-field Langevin equations

Uniform-in-time propagation of chaos for mean field Langevin dynamics

A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimiax Optimization

A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization