Abstract:The proximal gradient method is a standard approach to solve the composite minimization problems where the objective function is the sum of a continuously differentiable function and a lower semicontinuous, extended-valued function. For both monotone and nonmonotone proximal gradient methods, the convergence theory has traditionally replied heavily on the assumption of global Lipschitz continuity. Recent works have shown that the monotone proximal gradient method, even when the local Lipschitz continuity (rather than global) is assumed, converges to the stationarity globally in the presence of Kurdyka-Łojasiewicz Property. However, how to extend these results from monotone proximal gradient method to nonmonotone proximal gradient method (NPG) remains an open question. In this manuscript, we consider two types of NPG: those combined with average line search and max line search, respectively. By partitioning of indices into two subsets, one of them aims to achieve a decrease in the functional sequence, we establish the global convergence and rate-of-convergence (same as the monotone version) results under the KL property, merely requiring the local Lipschitz assumption, and without an a priori knowledge of the iterative sequence being bounded. When our work is almost done, we noticed that [17] presented the analogous results for the NPG with average line search, whose partitioning of index set is totally different with ours. Drawing upon the findings in this manuscript and [17], we confidently conclude that the convergence theory of NPG is independent on the specific partitioning of the index set.

Advances in Nonmonotone Proximal Gradient Methods merely with Local Lipschitz Assumptions in the Presense of Kurdyka-Łojasiewicz Property: A Study of Average and Max Line Search

Convergence of Nonmonotone Proximal Gradient Methods under the Kurdyka-Lojasiewicz Property without a Global Lipschitz Assumption

The convergence of conjugate gradient method with nonmonotone line search

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Proximal Gradient Method with Extrapolation and Line Search for a Class of Nonconvex and Nonsmooth Problems

Adaptive proximal algorithms for convex optimization under local Lipschitz continuity of the gradient

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

A Unified Analysis for the Subgradient Methods Minimizing Composite Nonconvex, Nonsmooth and Non-Lipschitz Functions.

Bregman Proximal Gradient Algorithm with Extrapolation for a Class of Nonconvex Nonsmooth Minimization Problems

A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization.

On the Convergence of Newton-type Proximal Gradient Method for Multiobjective Optimization Problems

Projective Proximal Gradient Descent for A Class of Nonconvex Nonsmooth Optimization Problems: Fast Convergence Without Kurdyka-Lojasiewicz (KL) Property

A Note on the Accelerated Proximal Gradient Method for Nonconvex Optimization

Accelerated Proximal Gradient Methods for Nonconvex Programming

Adaptive proximal gradient methods are universal without approximation

A Bregman Stochastic Method for Nonconvex Nonsmooth Problem Beyond Global Lipschitz Gradient Continuity.

A class of modified accelerated proximal gradient methods for nonsmooth and nonconvex minimization problems

Nonconvex Stochastic Bregman Proximal Gradient Method for Nonconvex Composite Problems

The Global R-linear Convergence of Nesterov's Accelerated Gradient Method with Unknown Strongly Convex Parameter

A Bregman Proximal Stochastic Gradient Method with Extrapolation for Nonconvex Nonsmooth Problems