Abstract:Subspace minimization conjugate gradient (SMCG) methods are a class of quite efficient iterative methods for unconstrained optimization and have received increasing attention recently. The search directions of SMCG methods are generated by minimizing an approximate model with the approximate matrix over the two-dimensional subspace spanned by the current gradient and the latest step. The main drawback of SMCG methods is that the parameter in the search directions must be determined when calculating the search directions. The parameter is crucial to SMCG methods and is difficult to be determined properly. An alternative solution for this drawback might be to exploit a new way to derive SMCG methods independent of . The projection technique has been used successfully to derive conjugate gradient directions such as the Dai–Kou conjugate gradient direction (Dai and Kou in SIAM J Optim 23(1):296–320, 2013). Motivated by the above two observations, we use a projection technique to derive a new SMCG method independent of . More specifically, we project the search direction of memoryless quasi-Newton method into the above two-dimensional subspace and derive a new search direction, which is proved to be descent. Remarkably, the proposed method without any line search enjoys the finite termination property for two-dimensional strictly convex quadratic functions. An adaptive scaling factor in the search direction is exploited based on the finite termination property. The proposed method does not need to determine the parameter and can be regarded as an extension of the Dai–Kou conjugate gradient method. The global convergence of the proposed method is established under the suitable assumptions. Numerical comparisons on the 147 test functions from the CUTEst library indicate that the proposed method is very promising.

Spectral projected subgradient method with a 1-memory momentum term for constrained multiobjective optimization problem

Memory gradient method for multiobjective optimization

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

Multi-stage stochastic gradient method with momentum acceleration

Scaled Proximal Gradient Methods for Multiobjective Optimization: Improved Linear Convergence and Nesterov's Acceleration

A Subspace Minimization Barzilai-Borwein Method for Multiobjective Optimization Problems

A Globally Convergent Gradient Method with Momentum

Stochastic Momentum Method with Double Acceleration for Regularized Empirical Risk Minimization

On the convergence of conditional gradient method for unbounded multiobjective optimization problems

Spectral conjugate gradient methods for vector optimization problems

A Proximal Gradient Method with an Explicit Line search for Multiobjective Optimization

Adaptive generalized conditional gradient method for multiobjective optimization

A New Subspace Minimization Conjugate Gradient Method for Unconstrained Minimization

A nonmonotone proximal quasi-Newton method for multiobjective optimization

Smoothing Accelerated Proximal Gradient Method with Fast Convergence Rate for Nonsmooth Multi-objective Optimization

Mirror descent method for stochastic multi-objective optimization

Non-Convex Stochastic Composite Optimization with Polyak Momentum

Variable Metric Method for Unconstrained Multiobjective Optimization Problems

Constrained Stochastic Recursive Momentum Successive Convex Approximation

On the Convergence of Newton-type Proximal Gradient Method for Multiobjective Optimization Problems

An effective subgradient algorithm via Mifflin's line search for nonsmooth nonconvex multiobjective optimization