Abstract:In this paper, we consider the problem that minimizing the sum of a nonsmooth function with a smooth one in the nonconvex setting, which arising in many contemporary applications such as machine learning, statistics, and signal/image processing. To solve this problem, we propose a new nonmonotone accelerated proximal gradient method with variable stepsize strategy. Note that incorporating inertial term into proximal gradient method is a simple and efficient acceleration technique, while the descent property of the proximal gradient algorithm will lost. In our algorithm, the iterates generated by inertial proximal gradient scheme are accepted when the objective function values decrease or increase appropriately; otherwise, the iteration point is generated by proximal gradient scheme, which makes the function values on a subset of iterates are decreasing. We also introduce a variable stepsize strategy, which does not need a line search or does not need to know the Lipschitz constant and makes the algorithm easy to implement. We show that the sequence of iterates generated by the algorithm converges to a critical point of the objective function. Further, under the assumption that the objective function satisfies the Kurdyka–Łojasiewicz inequality, we prove the convergence rates of the objective function values and the iterates. Moreover, numerical results on both convex and nonconvex problems are reported to demonstrate the effectiveness and superiority of the proposed method and stepsize strategy.

Two-step inertial Bregman alternating structure-adapted proximal gradient descent algorithm for nonconvex and nonsmooth problems

An Alternating Structure-Adapted Bregman Proximal Gradient Descent Algorithm for Constrained Nonconvex Nonsmooth Optimization Problems and Its Inertial Variant.

Accelerated inertial subgradient extragradient algorithms with non-monotonic step sizes for equilibrium problems and fixed point problems

Inertial self-adaptive algorithms for solving non-smooth convex optimization problems

Multi-step inertial algorithms for equilibrium, fixed point, general systems of variational inequalities and split feasibility problems

A Bregman Projection Algorithm with Self Adaptive Step Sizes for Split Variational Inequality Problems Involving Non-Lipschitz Operators

A stochastic two-step inertial Bregman proximal alternating linearized minimization algorithm for nonconvex and nonsmooth problems

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Alternated Multi-Step Inertial Iterative Algorithm for Solving the Split Feasibility Problem in Hilbert Spaces

Adaptive Hybrid Steepest Descent Algorithms Involving an Inertial Extrapolation Term for Split Monotone Variational Inclusion Problems

Accelerated Primal-Dual Proximal Gradient Splitting Methods for Convex-Concave Saddle-Point Problems

Modified Inertial Projection and Contraction Algorithms with Non-Monotonic Step Sizes for Solving Variational Inequalities and Their Applications

New self-adaptive methods with double inertial steps for solving splitting monotone variational inclusion problems with applications

A nonmonotone accelerated proximal gradient method with variable stepsize strategy for nonsmooth and nonconvex minimization problems

Some Accelerated Alternating Proximal Gradient Algorithms for a Class of Nonconvex Nonsmooth Problems

An Inertial Proximal Splitting Method with Applications

Subgradient Extragradient Methods for Equilibrium Problems and Fixed Point Problems in Hilbert Space

A New Accelerated Self-Adaptive Stepsize Algorithm with Excellent Stability for Split Common Fixed Point Problems

Mann-Type Inertial Accelerated Subgradient Extragradient Algorithm for Minimum-Norm Solution of Split Equilibrium Problems Induced by Fixed Point Problems in Hilbert Spaces

A Multi-step Inertial Forward-Backward Splitting Method for Non-convex Optimization.

An accelerated hybrid projection method with a self‐adaptive step‐size sequence for solving split common fixed point problems