Abstract:Non-linear versions of log-Sobolev inequalities, that link a free energy to its dissipation along the corresponding Wasserstein gradient flow (i.e. corresponds to Polyak-Lojasiewicz inequalities in this context), are known to provide global exponential long-time convergence to the free energy minimizers, and have been shown to hold in various contexts. However they cannot hold when the free energy admits critical points which are not global minimizers, which is for instance the case of the granular media equation in a double-well potential with quadratic attractive interaction at low temperature. This work addresses such cases, extending the general arguments when a log-Sobolev inequality only holds locally and, as an example, establishing such local inequalities for the granular media equation with quadratic interaction either in the one-dimensional symmetric double-well case or in higher dimension in the low temperature regime. The method provides quantitative convergence rates for initial conditions in a Wasserstein ball around the stationary solutions. The same analysis is carried out for the kinetic counterpart of the gradient flow, i.e. the corresponding Vlasov-Fokker-Planck equation. The local exponential convergence to stationary solutions for the mean-field equations, both elliptic and kinetic, is shown to induce for the corresponding particle systems a fast (i.e. uniform in the number or particles) decay of the particle system free energy toward the level of the non-linear limit.

A convergence result of a continuous model of deep learning via Łojasiewicz--Simon inequality

Convergence of SGD for Training Neural Networks with Sliced Wasserstein Losses

Convergence and non-convergence in a nonlocal gradient flow

Convergence Analysis of a Class of Nonsmooth Gradient Systems.

Convergence of stochastic gradient descent under a local Lojasiewicz condition for deep neural networks

Convergence analysis of OT-Flow for sample generation

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Convergence of continuous-time stochastic gradient descent with applications to linear deep neural networks

A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks

On the global convergence of Wasserstein gradient flow of the Coulomb discrepancy

Gradient flows on graphons: existence, convergence, continuity equations

On Convergence of Training Loss Without Reaching Stationary Points

Global Convergence Analysis of Deep Linear Networks with A One-neuron Layer

Convergence proof for stochastic gradient descent in the training of deep neural networks with ReLU activation for constant target functions

Convergence and Stability of Generalized Gradient Systems by Łojasiewicz Inequality with Application in Continuum Kuramoto Model

Local convergence rates for Wasserstein gradient flows and McKean-Vlasov equations with multiple stationary solutions

A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models

High Probability Convergence Bounds for Non-convex Stochastic Gradient Descent with Sub-Weibull Noise

Adversarial flows: A gradient flow characterization of adversarial attacks

On Non-local Convergence Analysis of Deep Linear Networks.