Abstract:Subspace minimization conjugate gradient (SMCG) methods are a class of quite efficient iterative methods for unconstrained optimization and have received increasing attention recently. The search directions of SMCG methods are generated by minimizing an approximate model with the approximate matrix over the two-dimensional subspace spanned by the current gradient and the latest step. The main drawback of SMCG methods is that the parameter in the search directions must be determined when calculating the search directions. The parameter is crucial to SMCG methods and is difficult to be determined properly. An alternative solution for this drawback might be to exploit a new way to derive SMCG methods independent of . The projection technique has been used successfully to derive conjugate gradient directions such as the Dai–Kou conjugate gradient direction (Dai and Kou in SIAM J Optim 23(1):296–320, 2013). Motivated by the above two observations, we use a projection technique to derive a new SMCG method independent of . More specifically, we project the search direction of memoryless quasi-Newton method into the above two-dimensional subspace and derive a new search direction, which is proved to be descent. Remarkably, the proposed method without any line search enjoys the finite termination property for two-dimensional strictly convex quadratic functions. An adaptive scaling factor in the search direction is exploited based on the finite termination property. The proposed method does not need to determine the parameter and can be regarded as an extension of the Dai–Kou conjugate gradient method. The global convergence of the proposed method is established under the suitable assumptions. Numerical comparisons on the 147 test functions from the CUTEst library indicate that the proposed method is very promising.

A derivative-free memoryless BFGS hyperplane projection method for solving large-scale nonlinear monotone equations

A Modified Perry's Conjugate Gradient Method-Based Derivative-Free Method for Solving Large-Scale Nonlinear Monotone Equations

An Efficient Three-Term Conjugate Gradient Method for Nonlinear Monotone Equations with Convex Constraints

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

A Derivative-Free Three-Term Projection Algorithm Involving Spectral Quotient for Solving Nonlinear Monotone Equations

The convergence of conjugate gradient method with nonmonotone line search

An Adaptive Family of Projection Methods for Constrained Monotone Nonlinear Equations with Applications

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A three-term subspace projection method for solving systems of nonlinear monotone equations

A MODIFIED SPECTRAL CONJUGATE GRADIENT PROJECTION METHOD FOR SOLVING NONLINEAR MONOTONE SYMMETRIC EQUATIONS

A New Hybrid Three-Term Conjugate Gradient Algorithm for Large-Scale Unconstrained Problems

A Projection Method for Solving Monotone Nonlinear Equations with Application

A Class of Three-Term Derivative-Free Methods for Large-Scale Nonlinear Monotone System of Equations and Applications to Image Restoration Problems

A Conjugate Projection Gradient Algorithm for Nonlinear Constrained Optimization

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

A Three-Terms Polak–Ribière–Polyak Conjugate Gradient Algorithm for Large-Scale Nonlinear Equations

Two Self-Adaptive Derivative-Free Methods with Restart Procedure for Constrained Nonlinear Equations with Applications

A hybrid BFGS-Like method for monotone operator equations with applications

A Conjugate Projection Gradient Algorithm with Global Convergence for Nonlinear Constrained Optimization

A New Subspace Minimization Conjugate Gradient Method for Unconstrained Minimization

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications