Abstract:The stationary point of optimization problems can be obtained via conjugate gradient (CG) methods without the second derivative. Many researchers have used this method to solve applications in various fields, such as neural networks and image restoration. In this study, we construct a three-term CG method that fulfills convergence analysis and a descent property. Next, in the second term, we employ a Hestenses-Stiefel CG formula with some restrictions to be positive. The third term includes a negative gradient used as a search direction multiplied by an accelerating expression. We also provide some numerical results collected using a strong Wolfe line search with different sigma values over 166 optimization functions from the CUTEr library. The result shows the proposed approach is far more efficient than alternative prevalent CG methods regarding central processing unit (CPU) time, number of iterations, number of function evaluations, and gradient evaluations. Moreover, we present some applications for the proposed three-term search direction in image restoration, and we compare the results with well-known CG methods with respect to the number of iterations, CPU time, as well as root-mean-square error (RMSE). Finally, we present three applications in regression analysis, image restoration, and electrical engineering.

A Modified Three-Term Conjugate Descent Derivative-Free Method for Constrained Nonlinear Monotone Equations and Signal Reconstruction Problems

Two Descent Dai-Yuan Conjugate Gradient Methods for Systems of Monotone Nonlinear Equations

A Projection Method for Solving Monotone Nonlinear Equations with Application

A Class of Three-Term Derivative-Free Methods for Large-Scale Nonlinear Monotone System of Equations and Applications to Image Restoration Problems

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

A Derivative-Free Three-Term Projection Algorithm Involving Spectral Quotient for Solving Nonlinear Monotone Equations

An Improved Three-Term Conjugate Gradient Algorithm for Constrained Nonlinear Equations under Non-Lipschitz Conditions and Its Applications

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A scaled three-term conjugate gradient method for unconstrained optimization

Two Self-Adaptive Derivative-Free Methods with Restart Procedure for Constrained Nonlinear Equations with Applications

An Efficient Three-Term Conjugate Gradient Method for Nonlinear Monotone Equations with Convex Constraints

A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing

A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization

An Adaptive Family of Projection Methods for Constrained Monotone Nonlinear Equations with Applications

A three-term conjugate gradient descent method with some applications

Descent three-term conjugate gradient methods based on secant conditions for unconstrained optimization

A New Version Coefficient Of Three-Term Conjugate Gradient Method To Solve Unconstrained Optimization

A Modified Perry's Conjugate Gradient Method-Based Derivative-Free Method for Solving Large-Scale Nonlinear Monotone Equations

A Three-Terms Polak–Ribière–Polyak Conjugate Gradient Algorithm for Large-Scale Nonlinear Equations

Modification of a conjugate gradient approach for convex constrained nonlinear monotone equations with applications in signal recovery and image restoration

Convergence Properties of an Iterative Method for Solving Symmetric Non-linear Equations