Abstract:Nonlinear conjugate gradient methods are among the most preferable and effortless methods to solve smooth optimization problems. Due to their clarity and low memory requirements, they are more desirable for solving large-scale smooth problems. Conjugate gradient methods make use of gradient and the previous direction information to determine the next search direction, and they require no numerical linear algebra. However, the utility of nonlinear conjugate gradient methods has not been widely employed in solving nonsmooth optimization problems. In this paper, a modified nonlinear conjugate gradient method, which achieves the global convergence property and numerical efficiency, is proposed to solve large-scale nonsmooth convex problems. The new method owns the search direction, which generates sufficient descent property and belongs to a trust region. Under some suitable conditions, the global convergence of the proposed algorithm is analyzed for nonsmooth convex problems. The numerical efficiency of the proposed algorithm is tested and compared with some existing methods on some large-scale nonsmooth academic test problems. The numerical results show that the new algorithm has a very good performance in solving large-scale nonsmooth problems.

Convergence of the Descent Nonlinear Conjugate Gradient Methods

The convergence of conjugate gradient method with nonmonotone line search

A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization

Guaranteed Descent Conjugate Gradient Methods with Modified Secant Condition

Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing

Two families of scaled three-term conjugate gradient methods with sufficient descent property for nonconvex optimization

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems

A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization

Some generalized three-term conjugate gradient methods based on CD approach for unconstrained optimization problems

Global Convergence of the Polak-Ribière and Hestenes-Stiefel Conjugate Gradient Methods for the Unconstrained Nonlinear Optimization

Descent three-term conjugate gradient methods based on secant conditions for unconstrained optimization

A New Three-Term Conjugate Gradient Algorithm with Modified Gradient-Differences for Solving Unconstrained Optimization Problems

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

Two modified conjugate gradient methods for unconstrained optimization

A Modified Nonlinear Conjugate Gradient Algorithm for Large-Scale Nonsmooth Convex Optimization

Two Descent Dai-Yuan Conjugate Gradient Methods for Systems of Monotone Nonlinear Equations

Solving unconstrained optimization problems with some three-term conjugate gradient methods

Globally Convergent Three-Term Conjugate Gradient Methods that Use Secant Conditions and Generate Descent Search Directions for Unconstrained Optimization

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

Conjugate gradient methods without line search for multiobjective optimization