Abstract:We present a unified framework to analyze the global convergence of Langevin dynamics based algorithms for nonconvex finite-sum optimization with $n$ component functions. At the core of our analysis is a direct analysis of the ergodicity of the numerical approximations to Langevin dynamics, which leads to faster convergence rates. Specifically, we show that gradient Langevin dynamics (GLD) and stochastic gradient Langevin dynamics (SGLD) converge to the almost minimizer within $\tilde O\big(nd/(\lambda\epsilon) \big)$ and $\tilde O\big(d^7/(\lambda^5\epsilon^5) \big)$ stochastic gradient evaluations respectively, where $d$ is the problem dimension, and $\lambda$ is the spectral gap of the Markov chain generated by GLD. Both results improve upon the best known gradient complexity results (Raginsky et al., 2017). Furthermore, for the first time we prove the global convergence guarantee for variance reduced stochastic gradient Langevin dynamics (SVRG-LD) to the almost minimizer within $\tilde O\big(\sqrt{n}d^5/(\lambda^4\epsilon^{5/2})\big)$ stochastic gradient evaluations, which outperforms the gradient complexities of GLD and SGLD in a wide regime. Our theoretical analyses shed some light on using Langevin dynamics based algorithms for nonconvex optimization with provable guarantees.

Analysis on an Improved Global Convergence for A Spectral Conjugate Gradient Method

The convergence of conjugate gradient method with nonmonotone line search

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

CONVERGENCE ANALYSIS ON A CLASS OF CONJUGATE GRADIENT METHODS WITHOUT SUFFICIENT DECREASE CONDITION

Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

Modified Conjugate Gradient Method with Global Convergence Property

A Conjugate Gradient Method with Global Convergence for Large-Scale Unconstrained Optimization Problems

Convergence Properties of Nonlinear Conjugate Gradient Methods.

A Modified HS Conjugate Gradient Method and Its Global Convergence

Global Convergence of the Polak-Ribière and Hestenes-Stiefel Conjugate Gradient Methods for the Unconstrained Nonlinear Optimization

Convergence Analysis of Asynchronous Stochastic Recursive Gradient Algorithms

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

A Modified Spectral Conjugate Gradient Method for Absolute Value Equations Associated with Second-Order Cones

A New Three-Term Spectral Conjugate Gradient Algorithm with Higher Numerical Performance for Solving Large Scale Optimization Problems Based on Quasi-Newton Equation.

The Convergence Rate and Necessary-and-Sufficient Condition for the Consistency of Isogeometric Collocation Method

Convergence of the Descent Nonlinear Conjugate Gradient Methods

Convergence Analysis of a Multigrid Method for a Nonlocal Model.

A family of spectral conjugate gradient method with strong convergence and its applications in image restoration and machine learning

On the Global Convergence of Majorization Minimization Algorithms for Nonconvex Optimization Problems.

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

Global Convergence Analysis of a New Nonmonotone BFGS Algorithm on Convex Objective Functions