Abstract:We introduce and investigate proper accelerations of the Dai–Liao (DL) conjugate gradient (CG) family of iterations for solving large-scale unconstrained optimization problems. The improvements are based on appropriate modifications of the CG update parameter in DL conjugate gradient methods. The leading idea is to combine search directions in accelerated gradient descent methods, defined based on the Hessian approximation by an appropriate diagonal matrix in quasi-Newton methods, with search directions in DL-type CG methods. The global convergence of the modified Dai–Liao conjugate gradient method has been proved on the set of uniformly convex functions. The efficiency and robustness of the newly presented methods are confirmed in comparison with similar methods, analyzing numerical results concerning the CPU time, a number of function evaluations, and the number of iterative steps. The proposed method is successfully applied to deal with an optimization problem arising in 2D robotic motion control.

A Modified Hestenes-Stiefel Conjugate Gradient Method with Sufficient Descent Condition and Conjugacy Condition.

The convergence of conjugate gradient method with nonmonotone line search

Guaranteed Descent Conjugate Gradient Methods with Modified Secant Condition

Convergence of the Descent Nonlinear Conjugate Gradient Methods

A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems

Modified parameter of Dai Liao conjugacy condition of the conjugate gradient method

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization

A Modified Dai–Liao Conjugate Gradient Method Based on a Scalar Matrix Approximation of Hessian and Its Application

Global Convergence of the Polak-Ribière and Hestenes-Stiefel Conjugate Gradient Methods for the Unconstrained Nonlinear Optimization

A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

Two families of scaled three-term conjugate gradient methods with sufficient descent property for nonconvex optimization

A New Dai-Liao Conjugate Gradient Method based on Approximately Optimal Stepsize for Unconstrained Optimization

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A family of limited memory three term conjugate gradient methods

Some three-term conjugate gradient methods with the new direction structure

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

A modified Polak-Ribiere-Polyak type conjugate gradient method with two stepsize strategies for vector optimization

A New effected Three-Term Hestenes-Stiefel Conjugate-Gradient Method for Solving Unconstrained Optimization Problems

A sufficient descent three-term conjugate gradient method via symmetric rank-one update for large-scale optimization