Abstract:In this paper, based on the hybrid conjugate gradient method and the convex combination technique, a new family of hybrid three-term conjugate gradient methods are proposed for solving unconstrained optimization. The conjugate parameter in the search direction is a hybrid of Dai-Yuan conjugate parameter and any one. The search direction then is the sum of the negative gradient direction and a convex combination in relation to the last search direction and the gradient at the previous iteration. Without choosing any specific conjugate parameters, we show that the search direction generated by the family always possesses the descent property independent of line search technique, and that it is globally convergent under usual assumptions and the weak Wolfe line search. To verify the effectiveness of the presented family, we further design a specific conjugate parameter, and perform medium-large-scale numerical experiments for smooth unconstrained optimization and image restoration problems. The numerical results show the encouraging efficiency and applicability of the proposed methods even compared with the state-of-the-art methods.

Hybrid Conjugate Gradient Methods for Unconstrained Optimization

Three New Hybrid Conjugate Gradient Methods for Optimization

The convergence of conjugate gradient method with nonmonotone line search

New Conjugate Gradient-Like Methods For Unconstrained Optimization

A New Hybrid Three-Term Conjugate Gradient Algorithm for Large-Scale Unconstrained Problems

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A New Hybrid Three-Term HS-DY Conjugate Gradient In Solving Unconstrained Optimization Problems

Some New Three-Term Hestenes–Stiefel Conjugate Gradient Methods with Affine Combination

A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization

Two modified conjugate gradient methods for unconstrained optimization

A HYBRID CONJUGATE GRADIENT METHOD FOR UNCONSTRAINED OPTIMIZATION WITH APPLICATION

Two Modified Three-Term Type Conjugate Gradient Methods And Their Global Convergence For Unconstrained Optimization

A new family of hybrid three-term conjugate gradient methods with applications in image restoration

Some generalized three-term conjugate gradient methods based on CD approach for unconstrained optimization problems

A New Hybrid Three-Term LS-CD Conjugate Gradient In Solving Unconstrained Optimization Problems

A Conjugate Gradient Method with Global Convergence for Large-Scale Unconstrained Optimization Problems

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

Two Modified Spectral Conjugate Gradient Methods And Their Global Convergence For Unconstrained Optimization

Proposed CG method to solve unconstrained optimization problems

An Extended Spectral Conjugate Gradient Method for Unconstrained Optimization Problems

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems