Abstract:Subspace minimization conjugate gradient (SMCG) methods are a class of quite efficient iterative methods for unconstrained optimization and have received increasing attention recently. The search directions of SMCG methods are generated by minimizing an approximate model with the approximate matrix over the two-dimensional subspace spanned by the current gradient and the latest step. The main drawback of SMCG methods is that the parameter in the search directions must be determined when calculating the search directions. The parameter is crucial to SMCG methods and is difficult to be determined properly. An alternative solution for this drawback might be to exploit a new way to derive SMCG methods independent of . The projection technique has been used successfully to derive conjugate gradient directions such as the Dai–Kou conjugate gradient direction (Dai and Kou in SIAM J Optim 23(1):296–320, 2013). Motivated by the above two observations, we use a projection technique to derive a new SMCG method independent of . More specifically, we project the search direction of memoryless quasi-Newton method into the above two-dimensional subspace and derive a new search direction, which is proved to be descent. Remarkably, the proposed method without any line search enjoys the finite termination property for two-dimensional strictly convex quadratic functions. An adaptive scaling factor in the search direction is exploited based on the finite termination property. The proposed method does not need to determine the parameter and can be regarded as an extension of the Dai–Kou conjugate gradient method. The global convergence of the proposed method is established under the suitable assumptions. Numerical comparisons on the 147 test functions from the CUTEst library indicate that the proposed method is very promising.

A General Two-Level Subspace Method for Nonlinear Optimization

Subspace Methods for Nonlinear Optimization

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

On high-order multilevel optimization strategies

A Multilevel Low-Rank Newton Method with Super-linear Convergence Rate and its Application to Non-convex Problems

Minimization Over the Nonconvex Sparsity Constraint Using A Hybrid First-order method

Randomized subspace regularized Newton method for unconstrained non-convex optimization

Learning the subspace of variation for global optimization of functions with low effective dimension

A Feasible Level Proximal Point Method for Nonconvex Sparse Constrained Optimization

An efficient inertial subspace minimization CG algorithm with convergence rate analysis for constrained nonlinear monotone equations

A Mixed and Superlinearly Convergent Algorithm for Constrained Optimization.

Scalable Subspace Methods for Derivative-Free Nonlinear Least-Squares Optimization

A Parallel Line Search Subspace Correction Method for Composite Convex Optimization

Reduced-Space Iteratively Reweighted Second-Order Methods for Nonconvex Sparse Regularization

Generalized Uniformly Optimal Methods for Nonlinear Programming

Randomized subspace gradient method for constrained optimization

A New Subspace Minimization Conjugate Gradient Method for Unconstrained Minimization

A Line Search Multigrid Method for Large-Scale Nonlinear Optimization

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A primal-dual interior-point relaxation method with global and rapidly local convergence for nonlinear programs

On Some Versions of Subspace Optimization Methods with Inexact Gradient Information