Abstract:In this work we propose a general nonmonotone line-search method for nonconvex multi\-objective optimization problems with convex constraints. At the $k$th iteration, the degree of nonmonotonicity is controlled by a vector $\nu_{k}$ with nonnegative components. Different choices for $\nu_{k}$ lead to different nonmonotone step-size rules. Assuming that the sequence $\left\{\nu_{k}\right\}_{k\geq 0}$ is summable, and that the $i$th objective function has Hölder continuous gradient with smoothness parameter $\theta_i \in(0,1]$, we show that the proposed method takes no more than $\mathcal{O}\left(\epsilon^{-\left(1+\frac{1}{\theta_{\min}}\right)}\right)$ iterations to find a $\epsilon$-approximate Pareto critical point for a problem with $m$ objectives and $\theta_{\min}= \min_{i=1,\dots, m} \{\theta_i\}$. In particular, this complexity bound applies to the methods proposed by Drummond and Iusem (Comput. Optim. Appl. 28: 5--29, 2004), by Fazzio and Schuverdt (Optim. Lett. 13: 1365--1379, 2019), and by Mita, Fukuda and Yamashita (J. Glob. Optim. 75: 63--90, 2019). The generality of our approach also allows the development of new methods for multiobjective optimization. As an example, we propose a new nonmonotone step-size rule inspired by the Metropolis criterion. Preliminary numerical results illustrate the benefit of nonmonotone line searches and suggest that our new rule is particularly suitable for multiobjective problems in which at least one of the objectives has many non-global local minimizers.

A class of nonmonotone Armijo-type line search method for unconstrained optimization

The convergence of conjugate gradient method with nonmonotone line search

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

A New Algorithm For Unconstrained Optimization Problem With The Form Of Sum Of Squares Minimization

Universal nonmonotone line search method for nonconvex multiobjective optimization problems with convex constraints

Modified Armijo line-search in Riemannian optimization with reduced computational cost

A modified nonmonotone trust region line search method

Modified Line Search Sequential Quadratic Methods for Equality-Constrained Optimization with Unified Global and Local Convergence Guarantees

A global and superlinearly convergent algorithm for nonlinear nondifferential convex programming problems with a generalized Armijo line-search

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

Barzilai and Borwein conjugate gradient method equipped with a non-monotone line search technique and its application on non-negative matrix factorization

A modulus-based nonmonotone line search method for nonlinear complementarity problems

Model Function Based Conditional Gradient Method with Armijo-like Line Search

Conjugate gradient methods without line search for multiobjective optimization

A Line Search Multigrid Method for Large-Scale Nonlinear Optimization

A MIXED SUPERLINEARLY CONVERGENT ALGORITHM WITH NONMONOTONE SEARCH FOR CONSTRAINED OPTIMIZATIONS

Optimization of unconstrained problems using a developed algorithm of spectral conjugate gradient method calculation

Analysis of the gradient method with an Armijo–Wolfe line search on a class of non-smooth convex functions

A Branch-and-Bound Based Method for Solving Monotone Optimization Problems

A new proximal heavy ball inexact line-search algorithm

A simple uniformly optimal method without line search for convex optimization