Abstract:In this paper, based on the hybrid conjugate gradient method and the convex combination technique, a new family of hybrid three-term conjugate gradient methods are proposed for solving unconstrained optimization. The conjugate parameter in the search direction is a hybrid of Dai-Yuan conjugate parameter and any one. The search direction then is the sum of the negative gradient direction and a convex combination in relation to the last search direction and the gradient at the previous iteration. Without choosing any specific conjugate parameters, we show that the search direction generated by the family always possesses the descent property independent of line search technique, and that it is globally convergent under usual assumptions and the weak Wolfe line search. To verify the effectiveness of the presented family, we further design a specific conjugate parameter, and perform medium-large-scale numerical experiments for smooth unconstrained optimization and image restoration problems. The numerical results show the encouraging efficiency and applicability of the proposed methods even compared with the state-of-the-art methods.

An Improved Three-Term Conjugate Gradient Algorithm for Constrained Nonlinear Equations under Non-Lipschitz Conditions and Its Applications

The convergence of conjugate gradient method with nonmonotone line search

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

A modified inertial three-term conjugate gradient method for nonsmooth convex optimization and its application

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A New Three-Term Conjugate Gradient Algorithm with Modified Gradient-Differences for Solving Unconstrained Optimization Problems

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A New Version Coefficient Of Three-Term Conjugate Gradient Method To Solve Unconstrained Optimization

A new family of hybrid three-term conjugate gradient methods with applications in image restoration

A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing

Some convergently three-term trust region conjugate gradient algorithms under gradient function non-Lipschitz continuity

Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing

A New Hybrid Three-Term LS-CD Conjugate Gradient In Solving Unconstrained Optimization Problems

Some generalized three-term conjugate gradient methods based on CD approach for unconstrained optimization problems

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

A scaled three-term conjugate gradient method for unconstrained optimization

A New Scaled Three-Term Conjugate Gradient Algorithms For Unconstrained Optimization

A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations

Some three-term conjugate gradient methods with the new direction structure