Abstract:We present a unified framework to analyze the global convergence of Langevin dynamics based algorithms for nonconvex finite-sum optimization with $n$ component functions. At the core of our analysis is a direct analysis of the ergodicity of the numerical approximations to Langevin dynamics, which leads to faster convergence rates. Specifically, we show that gradient Langevin dynamics (GLD) and stochastic gradient Langevin dynamics (SGLD) converge to the almost minimizer within $\tilde O\big(nd/(\lambda\epsilon) \big)$ and $\tilde O\big(d^7/(\lambda^5\epsilon^5) \big)$ stochastic gradient evaluations respectively, where $d$ is the problem dimension, and $\lambda$ is the spectral gap of the Markov chain generated by GLD. Both results improve upon the best known gradient complexity results (Raginsky et al., 2017). Furthermore, for the first time we prove the global convergence guarantee for variance reduced stochastic gradient Langevin dynamics (SVRG-LD) to the almost minimizer within $\tilde O\big(\sqrt{n}d^5/(\lambda^4\epsilon^{5/2})\big)$ stochastic gradient evaluations, which outperforms the gradient complexities of GLD and SGLD in a wide regime. Our theoretical analyses shed some light on using Langevin dynamics based algorithms for nonconvex optimization with provable guarantees.

Reflection coupling for unadjusted generalized Hamiltonian Monte Carlo in the nonconvex stochastic gradient case

Coupling and Convergence for Hamiltonian Monte Carlo

Nonasymptotic analysis of Stochastic Gradient Hamiltonian Monte Carlo under local conditions for nonconvex optimization

Scalable couplings for the random walk Metropolis algorithm

Geometric ergodicity of SGLD via reflection coupling

Non-asymptotic convergence analysis of the stochastic gradient Hamiltonian Monte Carlo algorithm with discontinuous stochastic gradient with applications to training of ReLU neural networks

Second order quantitative bounds for unadjusted generalized Hamiltonian Monte Carlo

Sharp convergence rates for Langevin dynamics in the nonconvex setting

Convergence error analysis of reflected gradient Langevin dynamics for non-convex constrained optimization

Coupling Control Variates for Markov Chain Monte Carlo

Bounding Wasserstein distance with couplings

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

Contraction Rate Estimates of Stochastic Gradient Kinetic Langevin Integrators

Underdamped Langevin MCMC: A non-asymptotic analysis

Coupling Methods and Applications on Path Dependent McKean-Vlasov SDEs

Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited

Kinetic Langevin MCMC Sampling Without Gradient Lipschitz Continuity - the Strongly Convex Case

HMC and underdamped Langevin united in the unadjusted convex smooth case

Convergence of kinetic Langevin samplers for non-convex potentials

Asymptotic Couplings by Reflection and Applications for Nonlinear Monotone SPDES