Abstract:There is growing interest in nonconvex minimax problems that is driven by an abundance of applications. Our focus is on nonsmooth, nonconvex-strongly concave minimax, thus departing from the more common weakly convex and smooth models assumed in the recent literature. We present proximal gradient schemes with either parallel or alternating steps. We show that both methods can be analyzed through a single scheme within a unified analysis that relies on expanding a general convergence mechanism used for analyzing nonconvex, nonsmooth optimization problems. In contrast to the current literature, which focuses on the complexity of obtaining nearly approximate stationary solutions, we prove subsequence convergence to a critical point of the primal objective and global convergence when the latter is semialgebraic. Furthermore, the complexity results we provide are with respect to approximate stationary solutions. Lastly, we expand the scope of problems that can be addressed by generalizing one of the steps with a Bregman proximal gradient update, and together with a few adjustments to the analysis, this allows us to extend the convergence and complexity results to this broader setting. Funding: The research of E. Cohen was partially supported by a doctoral fellowship from the Israel Science Foundation [Grant 2619-20] and Deutsche Forschungsgemeinschaft [Grant 800240]. The research of M. Teboulle was partially supported by the Israel Science Foundation [Grant 2619-20] and Deutsche Forschungsgemeinschaft [Grant 800240].

A proximal gradient method for control problems with nonsmooth and nonconvex control cost

Proximal Gradient Dynamics: Monotonicity, Exponential Convergence, and Applications

Output stabilization of boundary-controlled parabolic PDEs via gradient-based dynamic optimization

Stochastic proximal gradient methods for nonconvex problems in Hilbert spaces

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

A numerical solution approach for non-smooth optimal control problems based on the Pontryagin maximum principle

A Proximal-Gradient Method for Constrained Optimization

On the convergence of the gradient projection method for convex optimal control problems with bang–bang solutions

An interior proximal gradient method for nonconvex optimization

Linear‐quadratic control problems with L1‐control cost

On the convergence of proximal gradient methods for convex simple bilevel optimization

Gradient in the Problem of Controlling Processes Described by Linear Pseudohyperbolic Equations

Multigoal-oriented optimal control problems with nonlinear PDE constraints

Solving Semi-Linear Elliptic Optimal Control Problems with $L^1$-Cost via Regularization and RAS-Preconditioned Newton Methods

A fast iterative PDE-based algorithm for feedback controls of nonsmooth mean-field control problems

Convergence of Nonmonotone Proximal Gradient Methods under the Kurdyka-Lojasiewicz Property without a Global Lipschitz Assumption

Generic Properties of Conjugate Points in Optimal Control Problems

A globally convergent proximal Newton-type method in nonsmooth convex optimization

A Multilevel Approach for Stochastic Nonlinear Optimal Control

Alternating and Parallel Proximal Gradient Methods for Nonsmooth, Nonconvex Minimax: A Unified Convergence Analysis

An Inexact Riemannian Proximal Gradient Method