Abstract:The conjugate gradient method is a useful and powerful approach for solving large-scale minimization problems. Liu and Storey developed a conjugate gradient method, which has good numerical performance but no global convergence under traditional line searches such as Armijo line search, Wolfe line search, and Goldstein line search. In this paper we propose a new nonmonotone line search for Liu-Storey conjugate gradient method (LS in short). The new nonmonotone line search can guarantee the global convergence of LS method and has a good numerical performance. By estimating the Lipschitz constant of the derivative of objective functions in the new nonmonotone line search, we can find an adequate step size and substantially decrease the number of functional evaluations at each iteration. Numerical results show that the new approach is effective in practical computation.

Accelerating the Modified Levenberg-Marquardt Method for Nonlinear Equations.

The Modified Levenberg-Marquardt Method for Nonlinear Equations with Cubic Convergence

A Shamanskii-like Levenberg-Marquardt Method for Nonlinear Equations

An Adaptive Multi-step Levenberg–Marquardt Method

On the Convergence Rate of the Inexact Levenberg-Marquardt Method

On a New Updating Rule of the Levenberg–Marquardt Parameter

Inexact Levenberg-Marquardt Method for Nonlinear Equations

A New Adaptive Levenberg–Marquardt Method for Nonlinear Equations and Its Convergence Rate under the Hölderian Local Error Bound Condition

An accelerated adaptive two-step Levenberg–Marquardt method with the modified Metropolis criterion

The convergence of conjugate gradient method with nonmonotone line search

Convergence Properties of a Self-adaptive Levenberg-Marquardt Algorithm under Local Error Bound Condition

On the Convergence of the Accelerated Riccati Iteration Method.

A MODIFIED LEVENBERG-MARQUARDT ALGORITHM FOR SINGULAR SYSTEM OF NONLINEAR EQUATIONS

On the Levenberg-Marquardt Methods for Convex Constrained Nonlinear Equations

A Levenberg-Marquardt Algorithm with Correction for Singular System of Nonlinear Equations

On the Global Convergence of A Parameter-Adjusting Levenberg-Marquardt Method

On the Quadratic Convergence of the Levenberg-Marquardt Method Without Nonsingularity Assumption

On the Convergence of Levenberg-Marquardt Method for Solving Nonlinear Systems.

Global Complexity Bound of the Levenberg–Marquardt Method

A Generalized Adaptive Levenberg–Marquardt Method for Solving Nonlinear Ill-Posed Problems

On the Multi-Point Levenberg–Marquardt Method for Singular Nonlinear Equations