Abstract:Conjugate gradient methods are much effective for large‐scale unconstrained optimization problems by their simple computations and low memory requirements. The Perry conjugate gradient method has been considered to be one of the most efficient methods in the context of unconstrained minimization. However, a globally convergent result for general functions has not been established yet. In this paper, an improved three‐term Perry‐type algorithm is proposed which automatically satisfies the sufficient descent property independent of the accuracy of line search strategy. Under the standard Wolfe line search technique and a modified secant condition, the proposed algorithm is globally convergent for general nonlinear functions without convexity assumption. Numerical results compared with the Perry method for stability, two modified Perry‐type conjugate gradient methods and two effective three‐term conjugate gradient methods for large‐scale problems up to 300,000 dimensions indicate that the proposed algorithm is more efficient and reliable than the other methods for the testing problems. Additionally, we also apply it to some image restoration problems.

Convergence of the Nonmonotone Perry and Shanno Method for Optimization

Global Convergence of Perry_Shanno's Memoryless Quasi-Newton Method with Non-monotone Line Search

The convergence of conjugate gradient method with nonmonotone line search

A Nonmonotone Broyden Method for Unconstrained Optimization

A Conjugate Gradient Method with Global Convergence for Large-Scale Unconstrained Optimization Problems

A Modified Conjugacy Condition And Related Nonlinear Conjugate Gradient Method

A Modified Perry's Conjugate Gradient Method-Based Derivative-Free Method for Solving Large-Scale Nonlinear Monotone Equations

An improved descent Perry‐type algorithm for large‐scale unconstrained nonconvex problems and applications to image restoration problems

Extended Newton Methods for Multiobjective Optimization: Majorizing Function Technique and Convergence Analysis

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

An Efficient Three-Term Conjugate Gradient Method for Nonlinear Monotone Equations with Convex Constraints

On Convergence of the Gauss-Newton Method for Convex Composite Optimization

Global Convergence of Modified Conjugate Gradient Methods

A Conjugate Projection Gradient Algorithm with Global Convergence for Nonlinear Constrained Optimization

A Conjugate Projection Gradient Algorithm for Nonlinear Constrained Optimization

Convergence Properties of Nonlinear Conjugate Gradient Methods.

Convergence of the Descent Nonlinear Conjugate Gradient Methods

Global Convergence Analysis of a New Nonmonotone BFGS Algorithm on Convex Objective Functions

Convergence of Liu-Storey conjugate method with nonmonotone Armijo line search

Barzilai and Borwein conjugate gradient method equipped with a non-monotone line search technique and its application on non-negative matrix factorization

Convexification, Concavification and Monotonization in Global Optimization