Abstract:This paper studies the asymptotic behavior of the constant step Stochastic Gradient Descent for the minimization of an unknown function, defined as the expectation of a non convex, non smooth, locally Lipschitz random function. As the gradient may not exist, it is replaced by a certain operator: a reasonable choice is to use an element of the Clarke subdifferential of the random function; another choice is the output of the celebrated backpropagation algorithm, which is popular amongst practioners, and whose properties have recently been studied by Bolte and Pauwels. Since the expectation of the chosen operator is not in general an element of the Clarke subdifferential of the mean function, it has been assumed in the literature that an oracle of the Clarke subdifferential of the mean function is available. As a first result, it is shown in this paper that such an oracle is not needed for almost all initialization points of the algorithm. Next, in the small step size regime, it is shown that the interpolated trajectory of the algorithm converges in probability (in the compact convergence sense) towards the set of solutions of a particular differential inclusion: the subgradient flow. Finally, viewing the iterates as a Markov chain whose transition kernel is indexed by the step size, it is shown that the invariant distribution of the kernel converge weakly to the set of invariant distribution of this differential inclusion as the step size tends to zero. These results show that when the step size is small, with large probability, the iterates eventually lie in a neighborhood of the critical points of the mean function.

Convergence of ZH-type nonmonotone descent method for Kurdyka-Łojasiewicz optimization problems

Convergence of Descent Methods under Kurdyka-Łojasiewicz Properties

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Convergence of Nonmonotone Proximal Gradient Methods under the Kurdyka-Lojasiewicz Property without a Global Lipschitz Assumption

A KL-based Analysis Framework with Applications to Non-Descent Optimization Methods

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Convergence depth control for interior point methods

A new use of the Kurdyka-Lojasiewicz property to study asymptotic behaviours of some stochastic optimization algorithms in a non-convex differentiable framework

Convergence of a class of algorithms with the level-set subdifferential error bound

A stochastic use of the Kurdyka-Lojasiewicz property: Investigation of optimization algorithms behaviours in a non-convex differentiable framework

On the Global Convergence of Majorization Minimization Algorithms for Nonconvex Optimization Problems.

A Generalized Version of Chung's Lemma and its Applications

Projective Proximal Gradient Descent for A Class of Nonconvex Nonsmooth Optimization Problems: Fast Convergence Without Kurdyka-Lojasiewicz (KL) Property

Can Decentralized Stochastic Minimax Optimization Algorithms Converge Linearly for Finite-Sum Nonconvex-Nonconcave Problems?

Convex and Non-convex Optimization Under Generalized Smoothness

Convergence Rates of Stochastic Zeroth-order Gradient Descent for \L ojasiewicz Functions

A modified Polak-Ribiere-Polyak type conjugate gradient method with two stepsize strategies for vector optimization

Convergence of Constant Step Stochastic Gradient Descent for Non-Smooth Non-Convex Functions

Descent Methods for Vector Optimization Problems: A Majorization-Minimization Perspective

Accelerated Algorithms for Nonconvex Optimization