Abstract:We study the problem of non-convex optimization using Stochastic Gradient Langevin Dynamics (SGLD). SGLD is a natural and popular variation of stochastic gradient descent where at each step, appropriately scaled Gaussian noise is added. To our knowledge, the only strategy for showing global convergence of SGLD on the loss function is to show that SGLD can sample from a stationary distribution which assigns larger mass when the function is small (the Gibbs measure), and then to convert these guarantees to optimization results. We employ a new strategy to analyze the convergence of SGLD to global minima, based on Lyapunov potentials and optimization. We convert the same mild conditions from previous works on SGLD into geometric properties based on Lyapunov potentials. This adapts well to the case with a stochastic gradient oracle, which is natural for machine learning applications where one wants to minimize population loss but only has access to stochastic gradients via minibatch training samples. Here we provide 1) improved rates in the setting of previous works studying SGLD for optimization, 2) the first finite gradient complexity guarantee for SGLD where the function is Lipschitz and the Gibbs measure defined by the function satisfies a Poincaré Inequality, and 3) prove if continuous-time Langevin Dynamics succeeds for optimization, then discrete-time SGLD succeeds under mild regularity assumptions.

Functional Central Limit Theorem and Strong Law of Large Numbers for Stochastic Gradient Langevin Dynamics

Generalization Bounds for Stochastic Gradient Langevin Dynamics: A Unified View Via Information Leakage Analysis

The functional central limit theorem for linear processes with strong near-epoch dependent innovations

On the stability of the stochastic gradient Langevin algorithm with dependent data stream

Langevin Dynamics: A Unified Perspective on Optimization via Lyapunov Potentials

A sharp uniform-in-time error estimate for Stochastic Gradient Langevin Dynamics

Stochastic Gradient and Langevin Processes

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

Utilising the CLT Structure in Stochastic Gradient based Sampling : Improved Analysis and Faster Algorithms

Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent

Laplacian Smoothing Stochastic Gradient Markov Chain Monte Carlo

Subsampling Error in Stochastic Gradient Langevin Diffusions

Functional Central Limit Theorem for Two Timescale Stochastic Approximation

Time-Independent Information-Theoretic Generalization Bounds for SGLD

Exact Langevin Dynamics with Stochastic Gradients

Stochastic Langevin Differential Inclusions with Applications to Machine Learning

Limit Theorems for Stochastic Gradient Descent with Infinite Variance

Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index models

Hitting Time of Stochastic Gradient Langevin Dynamics to Stationary Points: A Direct Analysis

Langevin algorithms for Markovian Neural Networks and Deep Stochastic control