Abstract:Recently, important contributions on convergence studies of conjugate gradient methods were made by Gilbert and Nocedal [SIAM J. Optim., 2 (1992), pp. 21--42]. They introduce a "sufficient descent condition" to establish global convergence results. Although this condition is not needed in the convergence analyses of Newton and quasi-Newton methods, Gilbert and Nocedal hint that the sufficient descent condition, which was enforced by their two-stage line search algorithm, may be crucial for ensuring the global convergence of conjugate gradient methods. This paper shows that the sufficient descent condition is actually not needed in the convergence analyses of conjugate gradient methods. Consequently, convergence results on the Fletcher--Reeves- and Polak--Ribière-type methods are established in the absence of the sufficient descent condition. To show the differences between the convergence properties of Fletcher--Reeves- and Polak--Ribière-type methods, two examples are constructed, showing that neither the boundedness of the level set nor the restriction $\beta_k \geq 0$ can be relaxed for the Polak--Ribière-type methods.

Global Convergence of the Polak-Ribière and Hestenes-Stiefel Conjugate Gradient Methods for the Unconstrained Nonlinear Optimization

The convergence of conjugate gradient method with nonmonotone line search

Global Convergence of Modified Conjugate Gradient Methods

Global Convergence of a Modified Spectral Conjugate Gradient Method

A Conjugate Projection Gradient Algorithm with Global Convergence for Nonlinear Constrained Optimization

CONVERGENCE ANALYSIS ON A CLASS OF CONJUGATE GRADIENT METHODS WITHOUT SUFFICIENT DECREASE CONDITION

Global Convergence of Hager-Zhang type Riemannian Conjugate Gradient Method

A Modified Hestenes-Stiefel Conjugate Gradient Algorithm for Large-Scale Optimization

Global Convergence of a Modified Hestenes-Stiefel Nonlinear Conjugate Gradient Method with Armijo Line Search

Convergence Properties of Nonlinear Conjugate Gradient Methods.

Global Convergence of A Nonlinear Extended Hybrid Conjugate Gradient Method with Wolfe Type Line Search

TWO FUNDAMENTAL CONVERGENCE THEOREMS FOR NONLINEAR CONJUGATE GRADIENT METHODS AND THEIR APPLICATIONS

Convergence of the Descent Nonlinear Conjugate Gradient Methods

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

A Conjugate Projection Gradient Algorithm for Nonlinear Constrained Optimization

Global convergence of a conjugate descent algorithm

A Conjugate Gradient Method with Global Convergence for Large-Scale Unconstrained Optimization Problems

A Modified HS Conjugate Gradient Method and Its Global Convergence

A Modified Projected Conjugate Gradient Algorithm for Unconstrained Optimization Problems

Some New Three-Term Hestenes–Stiefel Conjugate Gradient Methods with Affine Combination

A modified Polak-Ribiere-Polyak type conjugate gradient method with two stepsize strategies for vector optimization