Abstract:The proximal gradient method is a standard approach to solve the composite minimization problems where the objective function is the sum of a continuously differentiable function and a lower semicontinuous, extended-valued function. For both monotone and nonmonotone proximal gradient methods, the convergence theory has traditionally replied heavily on the assumption of global Lipschitz continuity. Recent works have shown that the monotone proximal gradient method, even when the local Lipschitz continuity (rather than global) is assumed, converges to the stationarity globally in the presence of Kurdyka-Łojasiewicz Property. However, how to extend these results from monotone proximal gradient method to nonmonotone proximal gradient method (NPG) remains an open question. In this manuscript, we consider two types of NPG: those combined with average line search and max line search, respectively. By partitioning of indices into two subsets, one of them aims to achieve a decrease in the functional sequence, we establish the global convergence and rate-of-convergence (same as the monotone version) results under the KL property, merely requiring the local Lipschitz assumption, and without an a priori knowledge of the iterative sequence being bounded. When our work is almost done, we noticed that [17] presented the analogous results for the NPG with average line search, whose partitioning of index set is totally different with ours. Drawing upon the findings in this manuscript and [17], we confidently conclude that the convergence theory of NPG is independent on the specific partitioning of the index set.

Tight Convergence Rate in Subgradient Norm of the Proximal Point Algorithm

Tight Sublinear Convergence Rate of the Proximal Point Algorithm for Maximal Monotone Inclusion Problems

Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

Tight Ergodic Sublinear Convergence Rate of the Relaxed Proximal Point Algorithm for Monotone Variational Inequalities

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Convergence analysis of gauss-type proximal point method for metrically regular mappings

Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

A Unified Analysis for the Subgradient Methods Minimizing Composite Nonconvex, Nonsmooth and Non-Lipschitz Functions.

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

On the linear convergence rate of Riemannian proximal gradient method

Convergence of Nonmonotone Proximal Gradient Methods under the Kurdyka-Lojasiewicz Property without a Global Lipschitz Assumption

Convergence results for proximal point algorithm with inertial and correction terms

New nonasymptotic convergence rates of stochastic proximal pointalgorithm for convex optimization problems

Explicit Convergence Rate of The Proximal Point Algorithm under R-Continuity

Proximal Subgradient Algorithm for a Class of Nonconvex Bilevel Equilibrium Problems

A Symplectic Discretization Based Proximal Point Algorithm for Convex Minimization

Local Conditions for Global Convergence of Gradient Flows and Proximal Point Sequences in Metric Spaces

Advances in Nonmonotone Proximal Gradient Methods merely with Local Lipschitz Assumptions in the Presense of Kurdyka-Łojasiewicz Property: A Study of Average and Max Line Search

Linear Convergence of the Derivative-Free Proximal Bundle Method on Convex Nonsmooth Functions, with Application to the Derivative-Free -Algorithm