Abstract:In this paper, we consider the problem that minimizing the sum of a nonsmooth function with a smooth one in the nonconvex setting, which arising in many contemporary applications such as machine learning, statistics, and signal/image processing. To solve this problem, we propose a new nonmonotone accelerated proximal gradient method with variable stepsize strategy. Note that incorporating inertial term into proximal gradient method is a simple and efficient acceleration technique, while the descent property of the proximal gradient algorithm will lost. In our algorithm, the iterates generated by inertial proximal gradient scheme are accepted when the objective function values decrease or increase appropriately; otherwise, the iteration point is generated by proximal gradient scheme, which makes the function values on a subset of iterates are decreasing. We also introduce a variable stepsize strategy, which does not need a line search or does not need to know the Lipschitz constant and makes the algorithm easy to implement. We show that the sequence of iterates generated by the algorithm converges to a critical point of the objective function. Further, under the assumption that the objective function satisfies the Kurdyka–Łojasiewicz inequality, we prove the convergence rates of the objective function values and the iterates. Moreover, numerical results on both convex and nonconvex problems are reported to demonstrate the effectiveness and superiority of the proposed method and stepsize strategy.

Modified proximal gradient methods involving double inertial extrapolations for monotone inclusion

Accelerated forward–backward algorithms for structured monotone inclusions

Accelerated inertial subgradient extragradient algorithms with non-monotonic step sizes for equilibrium problems and fixed point problems

Strong Convergence of Inertial Forward–backward Methods for Solving Monotone Inclusions

A strongly convergent inertial inexact proximal-point algorithm for monotone inclusions with applications to variational inequalities

Subgradient extragradient method with double inertial steps for quasi-monotone variational inequalities

A modified inertial three-term conjugate gradient method for nonsmooth convex optimization and its application

Multidimensional extrapolated global proximal gradient and applications for image processing

A nonmonotone accelerated proximal gradient method with variable stepsize strategy for nonsmooth and nonconvex minimization problems

On relaxed inertial projection and contraction algorithms for solving monotone inclusion problems

Adaptive Hybrid Steepest Descent Algorithms Involving an Inertial Extrapolation Term for Split Monotone Variational Inclusion Problems

A modified subgradient extragradient method with non-monotonic step sizes for solving quasimonotone variational inequalities

Convergence of inertial prox-penalization and inertial forward–backward algorithms for solving monotone bilevel equilibrium problems

Modified Inertial Projection and Contraction Algorithms with Non-Monotonic Step Sizes for Solving Variational Inequalities and Their Applications

Double inertial steps extragadient-type methods for solving optimal control and image restoration problems

New self-adaptive methods with double inertial steps for solving splitting monotone variational inclusion problems with applications

An innovative inertial extra-proximal gradient algorithm for solving convex optimization problems with application to image and signal processing

Inertial Extragradient Algorithms with Non-Monotone Stepsizes for Pseudomonotone Variational Inequalities and Applications

On the convergence of the iterates of proximal gradient algorithm with extrapolation for convex nonsmooth minimization problems

A Relaxed Inertial Method for Solving Monotone Inclusion Problems with Applications

Linear convergence of forward-backward accelerated algorithms without knowledge of the modulus of strong convexity