Abstract:In this paper, we consider the problem that minimizing the sum of a nonsmooth function with a smooth one in the nonconvex setting, which arising in many contemporary applications such as machine learning, statistics, and signal/image processing. To solve this problem, we propose a new nonmonotone accelerated proximal gradient method with variable stepsize strategy. Note that incorporating inertial term into proximal gradient method is a simple and efficient acceleration technique, while the descent property of the proximal gradient algorithm will lost. In our algorithm, the iterates generated by inertial proximal gradient scheme are accepted when the objective function values decrease or increase appropriately; otherwise, the iteration point is generated by proximal gradient scheme, which makes the function values on a subset of iterates are decreasing. We also introduce a variable stepsize strategy, which does not need a line search or does not need to know the Lipschitz constant and makes the algorithm easy to implement. We show that the sequence of iterates generated by the algorithm converges to a critical point of the objective function. Further, under the assumption that the objective function satisfies the Kurdyka–Łojasiewicz inequality, we prove the convergence rates of the objective function values and the iterates. Moreover, numerical results on both convex and nonconvex problems are reported to demonstrate the effectiveness and superiority of the proposed method and stepsize strategy.

Proximal extrapolated gradient methods with larger step size for monotone variational inequalities

Subgradient extragradient method with double inertial steps for quasi-monotone variational inequalities

An accelerated stochastic extragradient-like algorithm with new stepsize rules for stochastic variational inequalities

A nonmonotone accelerated proximal gradient method with variable stepsize strategy for nonsmooth and nonconvex minimization problems

An accelerated subgradient extragradient algorithm for solving bilevel variational inequality problems involving non-Lipschitz operator

Extension of the subgradient extragradient algorithm for solving variational inequalities without monotonicity

A modified subgradient extragradient method with non-monotonic step sizes for solving quasimonotone variational inequalities

Extragradient method with feasible inexact projection to variational inequality problem

Viscosity extragradient algorithms with double inertial extrapolation steps for quasimonotone variational inequalities and fixed point problems

Projection and contraction method with double inertial steps for quasi-monotone variational inequalities

Stochastic Bregman extragradient algorithm with line search for stochastic mixed variational inequalities

Double inertial extragradient algorithms for solving variational inequality problems with convergence analysis

Modified Extragradient Methods for Solving Variational Inequalities

Simple and optimal methods for stochastic variational inequalities, I: operator extrapolation

Adaptive inertial subgradient extragradient methods for finding minimum-norm solutions of pseudomonotone variational inequalities

Two subgradient extragradient methods based on the golden ratio technique for solving variational inequality problems

New Extragradient-Type Methods for Solving Variational Inequalities

New extrapolation projection contraction algorithms based on the golden ratio for pseudo-monotone variational inequalities

Adaptive Methods or Variational Inequalities with Relatively Smooth and Reletively Strongly Monotone Operators

A search-free $O(1/k^{3/2})$ homotopy inexact proximal-Newton extragradient algorithm for monotone variational inequalities

On the convergence of proximal gradient methods for convex simple bilevel optimization