Abstract:In this paper, based on the hybrid conjugate gradient method and the convex combination technique, a new family of hybrid three-term conjugate gradient methods are proposed for solving unconstrained optimization. The conjugate parameter in the search direction is a hybrid of Dai-Yuan conjugate parameter and any one. The search direction then is the sum of the negative gradient direction and a convex combination in relation to the last search direction and the gradient at the previous iteration. Without choosing any specific conjugate parameters, we show that the search direction generated by the family always possesses the descent property independent of line search technique, and that it is globally convergent under usual assumptions and the weak Wolfe line search. To verify the effectiveness of the presented family, we further design a specific conjugate parameter, and perform medium-large-scale numerical experiments for smooth unconstrained optimization and image restoration problems. The numerical results show the encouraging efficiency and applicability of the proposed methods even compared with the state-of-the-art methods.

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

The convergence of conjugate gradient method with nonmonotone line search

A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A new family of hybrid three-term conjugate gradient methods with applications in image restoration

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

A derivative-free memoryless BFGS hyperplane projection method for solving large-scale nonlinear monotone equations

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

An Improved Three-Term Conjugate Gradient Algorithm for Constrained Nonlinear Equations under Non-Lipschitz Conditions and Its Applications

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A modified inertial three-term conjugate gradient method for nonsmooth convex optimization and its application

A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

Hybrid Hu-Storey type methods for large-scale nonlinear monotone systems and signal recovery

A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization

An inertial Fletcher–Reeves-type conjugate gradient projection-based method and its spectral extension for constrained nonlinear equations

A New Hybrid Three-Term LS-CD Conjugate Gradient In Solving Unconstrained Optimization Problems

A hybrid BFGS-Like method for monotone operator equations with applications

A New Three-Term Conjugate Gradient Algorithm with Modified Gradient-Differences for Solving Unconstrained Optimization Problems

A three-term subspace projection method for solving systems of nonlinear monotone equations

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems

Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing