Abstract:The Conjugate Gradient (CG) method is renowned for its rapid convergence in optimization applications. Over the years, several modifications to CG methods have emerged to improve computational efficiency and tackle practical challenges. This paper presents a new three-term hybrid CG method for solving unconstrained optimization problems. This algorithm utilizes a search direction that combines Liu-Storey (LS) and Conjugate Descent (CD) CG coefficients and standardizes it using a spectral which acts as a scheme for the choices of the conjugate parameters. This resultant direction closely approximates the memoryless Broyden-Fletcher-Goldfarb-Shanno (BFGS) quasi-Newton direction, known for its bounded nature and compliance with the sufficient descent condition. The paper establishes the global convergence under standard Wolfe conditions and some appropriate assumptions. Additionally, the numerical experiments were conducted to emphasize the robustness and superior efficiency of this hybrid algorithm in comparison to existing approaches.

A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization

A New Hybrid Three-Term Conjugate Gradient Algorithm for Large-Scale Unconstrained Problems

A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization

A scaled three-term conjugate gradient method for unconstrained optimization

The convergence of conjugate gradient method with nonmonotone line search

Three New Hybrid Conjugate Gradient Methods for Optimization

A Conjugate Gradient Method with Descent Direction for Unconstrained Optimization

Descent three-term conjugate gradient methods based on secant conditions for unconstrained optimization

A New Descent Nonlinear Conjugate Gradient Method for Unconstrained Optimization

A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

Global convergence of a conjugate descent algorithm

Two families of scaled three-term conjugate gradient methods with sufficient descent property for nonconvex optimization

A Three-Term Conjugate Gradient Algorithm for Large-Scale Unconstrained Optimization Problems

A Conjugate Gradient Method with Global Convergence for Large-Scale Unconstrained Optimization Problems

Convergence of the Descent Nonlinear Conjugate Gradient Methods

Some New Three-Term Hestenes–Stiefel Conjugate Gradient Methods with Affine Combination

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems

Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing

A New Hybrid Three-Term HS-DY Conjugate Gradient In Solving Unconstrained Optimization Problems

A New Hybrid Three-Term LS-CD Conjugate Gradient In Solving Unconstrained Optimization Problems

An Improved Three-Term Conjugate Gradient Algorithm for Solving Unconstrained Optimization Problems