Abstract:Extrapolation, restart and stepsize are very powerful strategies for accelerating the convergence rates of first-order algorithms. In this paper, we propose a modified accelerated proximal gradient algorithm (modAPG), which incorporates the adaptive nonmonotone stepsize strategy, extrapolation and a modified rule of setting the extrapolation parameter to zero at some iterations, for solving a minimization problem composed of a smooth (possibly nonconvex) with Lipschitz continuous gradient and nonsmooth (possibly nonconvex) function. Moreover, the proposed algorithm has a simpler form for this problem with convex setting. We show that any cluster point of the sequence generated by modAPG is a critical point of the problem, and analyze the convergence rates of function values and iterates under the assumption that objective function has the Kurdyka-Łojasiewicz property. Finally, we conduct some preliminary numerical experiments for solving the convex problems, such as image deblurring problem and sparse logistic regression problem; and the nonconvex regularization problem, such as the L12\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${L_{\frac{1}{2}}}$$\end{document} penalty and the smoothly clipped absolute deviation (SCAD) penalty problem. Numerical experiments demonstrate the promising performance of the proposed method.

A Modified Polak–Ribi‘ere–Polyak Descent Method for Unconstrained Optimization

A Modified Projected Conjugate Gradient Algorithm for Unconstrained Optimization Problems

A Conjugate Gradient Method with Descent Direction for Unconstrained Optimization

A modified Polak-Ribiere-Polyak type conjugate gradient method with two stepsize strategies for vector optimization

New Spectral Prp Conjugate Gradient Method for Unconstrained Optimization

A modified descent nonlinear conjugate gradient method

Descent Methods for Vector Optimization Problems: A Majorization-Minimization Perspective

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Another Improved Wei–Yao–Liu Nonlinear Conjugate Gradient Method with Sufficient Descent Property

Global Convergence of the Polak-Ribière and Hestenes-Stiefel Conjugate Gradient Methods for the Unconstrained Nonlinear Optimization

A Barzilai-Borwein Descent Method for Multiobjective Optimization Problems

Convergence of the Peaceman-Rachford Splitting Method for a Class of Nonconvex Programs

A diagonal PRP-type projection method for convex constrained nonlinear monotone equations

Barzilai-Borwein Proximal Gradient Methods for Multiobjective Composite Optimization Problems with Improved Linear Convergence

Conjugate gradient methods without line search for multiobjective optimization

A class of modified accelerated proximal gradient methods for nonsmooth and nonconvex minimization problems

Global Convergence of a Modified Spectral Conjugate Gradient Method

A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization

A Proximal-Gradient Method for Constrained Optimization

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

Riemannian Modified Polak--Ribière--Polyak Conjugate Gradient Order Reduced Model by Tensor Techniques