Abstract:The stationary point of optimization problems can be obtained via conjugate gradient (CG) methods without the second derivative. Many researchers have used this method to solve applications in various fields, such as neural networks and image restoration. In this study, we construct a three-term CG method that fulfills convergence analysis and a descent property. Next, in the second term, we employ a Hestenses-Stiefel CG formula with some restrictions to be positive. The third term includes a negative gradient used as a search direction multiplied by an accelerating expression. We also provide some numerical results collected using a strong Wolfe line search with different sigma values over 166 optimization functions from the CUTEr library. The result shows the proposed approach is far more efficient than alternative prevalent CG methods regarding central processing unit (CPU) time, number of iterations, number of function evaluations, and gradient evaluations. Moreover, we present some applications for the proposed three-term search direction in image restoration, and we compare the results with well-known CG methods with respect to the number of iterations, CPU time, as well as root-mean-square error (RMSE). Finally, we present three applications in regression analysis, image restoration, and electrical engineering.

A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

A new family of hybrid three-term conjugate gradient methods with applications in image restoration

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems

Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing

A Descent Conjugate Gradient Algorithm for Optimization Problems and Its Applications in Image Restoration and Compression Sensing

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A modified inertial three-term conjugate gradient method for nonsmooth convex optimization and its application

An improved descent Perry‐type algorithm for large‐scale unconstrained nonconvex problems and applications to image restoration problems

The convergence of conjugate gradient method with nonmonotone line search

A three-term conjugate gradient descent method with some applications

Some generalized three-term conjugate gradient methods based on CD approach for unconstrained optimization problems

A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization

An Improved Three-Term Conjugate Gradient Algorithm for Constrained Nonlinear Equations under Non-Lipschitz Conditions and Its Applications

Two families of scaled three-term conjugate gradient methods with sufficient descent property for nonconvex optimization

A New Three-Term Conjugate Gradient Algorithm with Modified Gradient-Differences for Solving Unconstrained Optimization Problems

A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization

Some three-term conjugate gradient methods with the new direction structure

Convergence of the Descent Nonlinear Conjugate Gradient Methods

A family of spectral conjugate gradient method with strong convergence and its applications in image restoration and machine learning

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

A New Three-Term Spectral Conjugate Gradient Algorithm with Higher Numerical Performance for Solving Large Scale Optimization Problems Based on Quasi-Newton Equation.