Abstract:Despite its important applications in Machine Learning, min-max optimization of nonconvex-nonconcave objectives remains elusive. Not only are there no known first-order methods converging even to approximate local min-max points, but the computational complexity of identifying them is also poorly understood. In this paper, we provide a characterization of the computational complexity of the problem, as well as of the limitations of first-order methods in constrained min-max optimization problems with nonconvex-nonconcave objectives and linear constraints. As a warm-up, we show that, even when the objective is a Lipschitz and smooth differentiable function, deciding whether a min-max point exists, in fact even deciding whether an approximate min-max point exists, is NP-hard. More importantly, we show that an approximate local min-max point of large enough approximation is guaranteed to exist, but finding one such point is PPAD-complete. The same is true of computing an approximate fixed point of Gradient Descent/Ascent. An important byproduct of our proof is to establish an unconditional hardness result in the Nemirovsky-Yudin model. We show that, given oracle access to some function $f : P \to [-1, 1]$ and its gradient $\nabla f$, where $P \subseteq [0, 1]^d$ is a known convex polytope, every algorithm that finds a $\varepsilon$-approximate local min-max point needs to make a number of queries that is exponential in at least one of $1/\varepsilon$, $L$, $G$, or $d$, where $L$ and $G$ are respectively the smoothness and Lipschitzness of $f$ and $d$ is the dimension. This comes in sharp contrast to minimization problems, where finding approximate local minima in the same setting can be done with Projected Gradient Descent using $O(L/\varepsilon)$ many queries. Our result is the first to show an exponential separation between these two fundamental optimization problems.

Conservative parametric optimality and the ridge method for tame min-max problems

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Characterizing Parametric and Convergence Stability in Nonconvex and Nonsmooth Optimizations: A Geometric Approach

The effect of smooth parametrizations on nonconvex optimization landscapes

Marginal Analysis of Convex Optimization Problems with Set-Valued Inclusion Constraints

A Proximal-Gradient Method for Constrained Optimization

Gradient descent with nonconvex constraints: local concavity determines convergence

Fast convergence to non-isolated minima: four equivalent conditions for $\mathrm{C}^2$ functions

Heuristic Parameter Selection Based on Functional Minimization: Optimality and Model Function Approach

A Feasible Method for Optimization with Orthogonality Constraints

OKRidge: Scalable Optimal k-Sparse Ridge Regression

Optimization on Pareto sets: On a theory of multi-objective optimization

Optimization over convex polyhedra via Hadamard parametrizations

Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point

Optimization over bounded-rank matrices through a desingularization enables joint global and local guarantees

The sparse(st) optimization problem: reformulations, optimality, stationarity, and numerical results

Concave tents: a new tool for constructing concave reformulations of a large class of nonconvex optimization problems

The Complexity of Constrained Min-Max Optimization

On existence of solutions to non-convex minimization problems

How Free is Parameter-Free Stochastic Optimization?

Continuity of Parametric Optima for Possibly Discontinuous Functions and Noncompact Decision Sets