Abstract:In this work we propose a general nonmonotone line-search method for nonconvex multi\-objective optimization problems with convex constraints. At the $k$th iteration, the degree of nonmonotonicity is controlled by a vector $\nu_{k}$ with nonnegative components. Different choices for $\nu_{k}$ lead to different nonmonotone step-size rules. Assuming that the sequence $\left\{\nu_{k}\right\}_{k\geq 0}$ is summable, and that the $i$th objective function has Hölder continuous gradient with smoothness parameter $\theta_i \in(0,1]$, we show that the proposed method takes no more than $\mathcal{O}\left(\epsilon^{-\left(1+\frac{1}{\theta_{\min}}\right)}\right)$ iterations to find a $\epsilon$-approximate Pareto critical point for a problem with $m$ objectives and $\theta_{\min}= \min_{i=1,\dots, m} \{\theta_i\}$. In particular, this complexity bound applies to the methods proposed by Drummond and Iusem (Comput. Optim. Appl. 28: 5--29, 2004), by Fazzio and Schuverdt (Optim. Lett. 13: 1365--1379, 2019), and by Mita, Fukuda and Yamashita (J. Glob. Optim. 75: 63--90, 2019). The generality of our approach also allows the development of new methods for multiobjective optimization. As an example, we propose a new nonmonotone step-size rule inspired by the Metropolis criterion. Preliminary numerical results illustrate the benefit of nonmonotone line searches and suggest that our new rule is particularly suitable for multiobjective problems in which at least one of the objectives has many non-global local minimizers.

The convergence of conjugate gradient method with nonmonotone line search

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

A Conjugate Gradient Method with Global Convergence for Large-Scale Unconstrained Optimization Problems

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

Conjugate gradient methods without line search for multiobjective optimization

A Modified Nonlinear Conjugate Gradient Algorithm for Large-Scale Nonsmooth Convex Optimization

Convergence of the Descent Nonlinear Conjugate Gradient Methods

Barzilai and Borwein conjugate gradient method equipped with a non-monotone line search technique and its application on non-negative matrix factorization

A Modified Conjugacy Condition And Related Nonlinear Conjugate Gradient Method

Convergence Properties of Nonlinear Conjugate Gradient Methods.

A New Three-Term Conjugate Gradient Algorithm with Modified Gradient-Differences for Solving Unconstrained Optimization Problems

Modified Conjugate Gradient Method with Global Convergence Property

A Modified HS Conjugate Gradient Method and Its Global Convergence

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Modified Line Search Sequential Quadratic Methods for Equality-Constrained Optimization with Unified Global and Local Convergence Guarantees

A class of nonmonotone Armijo-type line search method for unconstrained optimization

Convergence of the Nonmonotone Perry and Shanno Method for Optimization

A Line Search Multigrid Method for Large-Scale Nonlinear Optimization

Universal nonmonotone line search method for nonconvex multiobjective optimization problems with convex constraints

Two families of scaled three-term conjugate gradient methods with sufficient descent property for nonconvex optimization

The global convergence of the BFGS method with a modified WWP line search for nonconvex functions