Abstract:A canonical algorithm for log-concave sampling is the Langevin Algorithm, aka the Langevin Diffusion run with some discretization stepsize $\eta > 0$. This discretization leads the Langevin Algorithm to have a stationary distribution $\pi_{\eta}$ which differs from the stationary distribution $\pi$ of the Langevin Diffusion, and it is an important challenge to understand whether the well-known properties of $\pi$ extend to $\pi_{\eta}$. In particular, while concentration properties such as isoperimetry and rapidly decaying tails are classically known for $\pi$, the analogous properties for $\pi_{\eta}$ are open questions with algorithmic implications. This note provides a first step in this direction by establishing concentration results for $\pi_{\eta}$ that mirror classical results for $\pi$. Specifically, we show that for any nontrivial stepsize $\eta > 0$, $\pi_{\eta}$ is sub-exponential (respectively, sub-Gaussian) when the potential is convex (respectively, strongly convex). Moreover, the concentration bounds we show are essentially tight. We also show that these concentration bounds extend to all iterates along the trajectory of the Langevin Algorithm, and to inexact implementations which use sub-Gaussian estimates of the gradient. Key to our analysis is the use of a rotation-invariant moment generating function (aka Bessel function) to study the stationary dynamics of the Langevin Algorithm. This technique may be of independent interest because it enables directly analyzing the discrete-time stationary distribution $\pi_{\eta}$ without going through the continuous-time stationary distribution $\pi$ as an intermediary.

Convergence in total variation for the kinetic Langevin algorithm

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

Sharp convergence rates for Langevin dynamics in the nonconvex setting

Concentration of the Langevin Algorithm's Stationary Distribution

Convergence of kinetic Langevin samplers for non-convex potentials

Contraction and Convergence Rates for Discretized Kinetic Langevin Dynamics

Convergence of Unadjusted Langevin in High Dimensions: Delocalization of Bias

Convergence Analysis of a Method for Variational Inclusions

Convergence in Total Variation for nonlinear functionals of random hyperspherical harmonics

Estimate of Exponential Convergence Rate in Total Variation by Spectral Gap

Gradual convergence for Langevin dynamics on a degenerate potential

Non-asymptotic entropic bounds for non-linear kinetic Langevin sampler with second-order splitting scheme

Convergence rate of random scan Coordinate Ascent Variational Inference under log-concavity

When is the Convergence Time of Langevin Algorithms Dimension Independent? A Composite Optimization Viewpoint

Convergence of Kinetic Langevin Monte Carlo on Lie groups

Convergence error analysis of reflected gradient Langevin dynamics for non-convex constrained optimization

Approximation schemes for McKean-Vlasov and Boltzmann type equations (error analyses in total variation distance)

Stable central limit theorem in total variation distance

Convergence and non-convergence in a nonlocal gradient flow