Abstract:The stationary point of optimization problems can be obtained via conjugate gradient (CG) methods without the second derivative. Many researchers have used this method to solve applications in various fields, such as neural networks and image restoration. In this study, we construct a three-term CG method that fulfills convergence analysis and a descent property. Next, in the second term, we employ a Hestenses-Stiefel CG formula with some restrictions to be positive. The third term includes a negative gradient used as a search direction multiplied by an accelerating expression. We also provide some numerical results collected using a strong Wolfe line search with different sigma values over 166 optimization functions from the CUTEr library. The result shows the proposed approach is far more efficient than alternative prevalent CG methods regarding central processing unit (CPU) time, number of iterations, number of function evaluations, and gradient evaluations. Moreover, we present some applications for the proposed three-term search direction in image restoration, and we compare the results with well-known CG methods with respect to the number of iterations, CPU time, as well as root-mean-square error (RMSE). Finally, we present three applications in regression analysis, image restoration, and electrical engineering.

A hybrid BFGS-Like method for monotone operator equations with applications

The convergence of conjugate gradient method with nonmonotone line search

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

A New Hybrid Three-Term LS-CD Conjugate Gradient In Solving Unconstrained Optimization Problems

A derivative-free memoryless BFGS hyperplane projection method for solving large-scale nonlinear monotone equations

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A HYBRID CONJUGATE GRADIENT METHOD FOR UNCONSTRAINED OPTIMIZATION WITH APPLICATION

A New Hybrid Three-Term HS-DY Conjugate Gradient In Solving Unconstrained Optimization Problems

Enhanced Projection Method for the Solution of the System of Nonlinear Equations Under a More General Assumption than Pseudo-Monotonicity and Lipschitz Continuity

A self-scaling memoryless BFGS based conjugate gradient method using multi-step secant condition for unconstrained minimization

A Parallel Method With Hybrid Algorithms For Mixed Integer Nonlinear Programming

A decent three term conjugate gradient method with global convergence properties for large scale unconstrained optimization problems

Barzilai and Borwein conjugate gradient method equipped with a non-monotone line search technique and its application on non-negative matrix factorization

Proposed CG method to solve unconstrained optimization problems

A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization

Fast hybrid method for solving variational inequalities beyond monotonicity in real Banach spaces

A three-term conjugate gradient descent method with some applications

An Improved Three-Term Conjugate Gradient Algorithm for Constrained Nonlinear Equations under Non-Lipschitz Conditions and Its Applications

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

A new family of hybrid three-term conjugate gradient method for unconstrained optimization with application to image restoration and portfolio selection

A scaled three-term conjugate gradient method for unconstrained optimization