Abstract:Nonlinear conjugate gradient methods are among the most preferable and effortless methods to solve smooth optimization problems. Due to their clarity and low memory requirements, they are more desirable for solving large-scale smooth problems. Conjugate gradient methods make use of gradient and the previous direction information to determine the next search direction, and they require no numerical linear algebra. However, the utility of nonlinear conjugate gradient methods has not been widely employed in solving nonsmooth optimization problems. In this paper, a modified nonlinear conjugate gradient method, which achieves the global convergence property and numerical efficiency, is proposed to solve large-scale nonsmooth convex problems. The new method owns the search direction, which generates sufficient descent property and belongs to a trust region. Under some suitable conditions, the global convergence of the proposed algorithm is analyzed for nonsmooth convex problems. The numerical efficiency of the proposed algorithm is tested and compared with some existing methods on some large-scale nonsmooth academic test problems. The numerical results show that the new algorithm has a very good performance in solving large-scale nonsmooth problems.

Barzilai and Borwein conjugate gradient method equipped with a non-monotone line search technique and its application on non-negative matrix factorization

The convergence of conjugate gradient method with nonmonotone line search

An Adaptive Nonmonotone Projected Barzilai-Borwein Gradient Method with Active Set Prediction for Nonnegative Matrix Factorization

A Modified Nonlinear Conjugate Gradient Algorithm for Large-Scale Nonsmooth Convex Optimization

On the acceleration of the Barzilai-Borwein method

A projected hybridization of the Hestenes–Stiefel and Dai–Yuan conjugate gradient methods with application to nonnegative matrix factorization

A Gradient-Based Algorithm with Nonmonotone Line Search for Nonnegative Matrix Factorization

A Modified Conjugacy Condition And Related Nonlinear Conjugate Gradient Method

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A Nonmonotone Filter Barzilai-Borwein Method for Optimization

A New Nonmonotone Spectral Conjugate Gradient Algorithm

Optimization of unconstrained problems using a developed algorithm of spectral conjugate gradient method calculation

A modified Polak-Ribiere-Polyak type conjugate gradient method with two stepsize strategies for vector optimization

EFFICIENT NONNEGATIVE MATRIX FACTORIZATION VIA MODIFIED MONOTONE BARZILAI-BORWEIN METHOD WITH ADAPTIVE STEP SIZES STRATEGY

New Conjugate Gradient-Like Methods For Unconstrained Optimization

Nonmonotone Variable Metric Barzilai-Borwein Method for Composite Minimization Problem

An optimal choice Dai-Liao conjugate gradient algorithm for unconstrained optimization and portfolio selection

An Efficient Three-Term Conjugate Gradient Method for Nonlinear Monotone Equations with Convex Constraints

A Conjugate Gradient Method with Global Convergence for Large-Scale Unconstrained Optimization Problems

An Improved Spectral Conjugate Gradient Algorithm for Nonconvex Unconstrained Optimization Problems

Equipping Barzilai-Borwein method with two dimensional quadratic termination property