Abstract:There is growing interest in nonconvex minimax problems that is driven by an abundance of applications. Our focus is on nonsmooth, nonconvex-strongly concave minimax, thus departing from the more common weakly convex and smooth models assumed in the recent literature. We present proximal gradient schemes with either parallel or alternating steps. We show that both methods can be analyzed through a single scheme within a unified analysis that relies on expanding a general convergence mechanism used for analyzing nonconvex, nonsmooth optimization problems. In contrast to the current literature, which focuses on the complexity of obtaining nearly approximate stationary solutions, we prove subsequence convergence to a critical point of the primal objective and global convergence when the latter is semialgebraic. Furthermore, the complexity results we provide are with respect to approximate stationary solutions. Lastly, we expand the scope of problems that can be addressed by generalizing one of the steps with a Bregman proximal gradient update, and together with a few adjustments to the analysis, this allows us to extend the convergence and complexity results to this broader setting. Funding: The research of E. Cohen was partially supported by a doctoral fellowship from the Israel Science Foundation [Grant 2619-20] and Deutsche Forschungsgemeinschaft [Grant 800240]. The research of M. Teboulle was partially supported by the Israel Science Foundation [Grant 2619-20] and Deutsche Forschungsgemeinschaft [Grant 800240].

Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point

Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penalties

An Inexact Riemannian Proximal Gradient Method

Inexact Riemannian Gradient Descent Method for Nonconvex Optimization

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

On the linear convergence rate of Riemannian proximal gradient method

Riemannian Proximal Gradient Methods (extended Version)

Riemannian proximal gradient methods

The Proximal Gradient Method for Composite Optimization Problems on Riemannian Manifolds

Convergence and Complexity Guarantee for Inexact First-order Riemannian Optimization Algorithms

A Riemannian Proximal Newton Method

Riemannian Stochastic Proximal Gradient Methods for Nonsmooth Optimization over the Stiefel Manifold

A Decentralized Proximal Gradient Tracking Algorithm for Composite Optimization on Riemannian Manifolds

Decentralized projected Riemannian gradient method for smooth optimization on compact submanifolds

Alternating and Parallel Proximal Gradient Methods for Nonsmooth, Nonconvex Minimax: A Unified Convergence Analysis

Anisotropic Proximal Gradient

Convergence Rate of Descent Method with New Inexact Line-Search on Riemannian Manifolds

A Proximal-Gradient Method for Constrained Optimization

Accelerated Bregman Proximal Gradient Methods for Relatively Smooth Convex Optimization