Abstract:The stationary point of optimization problems can be obtained via conjugate gradient (CG) methods without the second derivative. Many researchers have used this method to solve applications in various fields, such as neural networks and image restoration. In this study, we construct a three-term CG method that fulfills convergence analysis and a descent property. Next, in the second term, we employ a Hestenses-Stiefel CG formula with some restrictions to be positive. The third term includes a negative gradient used as a search direction multiplied by an accelerating expression. We also provide some numerical results collected using a strong Wolfe line search with different sigma values over 166 optimization functions from the CUTEr library. The result shows the proposed approach is far more efficient than alternative prevalent CG methods regarding central processing unit (CPU) time, number of iterations, number of function evaluations, and gradient evaluations. Moreover, we present some applications for the proposed three-term search direction in image restoration, and we compare the results with well-known CG methods with respect to the number of iterations, CPU time, as well as root-mean-square error (RMSE). Finally, we present three applications in regression analysis, image restoration, and electrical engineering.

Another Modified Version of RMIL Conjugate Gradient Method

A decent three term conjugate gradient method with global convergence properties for large scale unconstrained optimization problems

The convergence of conjugate gradient method with nonmonotone line search

Two efficient nonlinear conjugate gradient methods for Riemannian manifolds

Two sufficient descent spectral conjugate gradient algorithms for unconstrained optimization with application

A self-scaling memoryless BFGS based conjugate gradient method using multi-step secant condition for unconstrained minimization

Two modified conjugate gradient methods for unconstrained optimization

A Modified Dai–Liao Conjugate Gradient Method Based on a Scalar Matrix Approximation of Hessian and Its Application

Proposed CG method to solve unconstrained optimization problems

Modified parameter of Dai Liao conjugacy condition of the conjugate gradient method

A New Hybrid Three-Term LS-CD Conjugate Gradient In Solving Unconstrained Optimization Problems

A three-term conjugate gradient descent method with some applications

A New Version Coefficient Of Three-Term Conjugate Gradient Method To Solve Unconstrained Optimization

A Riemannian Proximal Newton-CG Method

Guaranteed Descent Conjugate Gradient Methods with Modified Secant Condition

A revised Liu–Storey conjugate gradient parameter for unconstrained optimization problems with applications

A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization

A new family of hybrid three-term conjugate gradient method for unconstrained optimization with application to image restoration and portfolio selection

An efficient modified conjugate gradient parameter for solving the system of symmetric nonlinear equations with application in motion control of coplanar robot

A New effected Three-Term Hestenes-Stiefel Conjugate-Gradient Method for Solving Unconstrained Optimization Problems

An efficient inertial subspace minimization CG algorithm with convergence rate analysis for constrained nonlinear monotone equations