Abstract:Much recent research effort has been directed to the development of efficient algorithms for solving minimax problems with theoretical convergence guarantees due to the relevance of these problems to a few emergent applications. In this paper, we propose a unified single-loop alternating gradient projection (AGP) algorithm for solving smooth nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. AGP employs simple gradient projection steps for updating the primal and dual variables alternatively at each iteration. We show that it can find an -stationary point of the objective function in (resp. ) iterations under nonconvex-strongly concave (resp. nonconvex–concave) setting. Moreover, its gradient complexity to obtain an -stationary point of the objective function is bounded by (resp., ) under the strongly convex–nonconcave (resp., convex–nonconcave) setting. To the best of our knowledge, this is the first time that a simple and unified single-loop algorithm is developed for solving both nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. Moreover, the complexity results for solving the latter (strongly) convex–nonconcave minimax problems have never been obtained before in the literature. Numerical results show the efficiency of the proposed AGP algorithm. Furthermore, we extend the AGP algorithm by presenting a block alternating proximal gradient (BAPG) algorithm for solving more general multi-block nonsmooth nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. We can similarly establish the gradient complexity of the proposed algorithm under these four different settings.

An Infeasible-Point Subgradient Method Using Adaptive Approximate Projections

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

A subgradient projection method for quasiconvex multiobjetive optimization

Nonsmooth Projection-Free Optimization with Functional Constraints

A nonmonotone accelerated proximal gradient method with variable stepsize strategy for nonsmooth and nonconvex minimization problems

Subgradient Projection Algorithms for Convex Feasibility on Riemannian Manifolds with Lower Bounded Curvatures

A feasible smoothing accelerated projected gradient method for nonsmooth convex optimization

Accelerated inertial subgradient extragradient algorithms with non-monotonic step sizes for equilibrium problems and fixed point problems

Variable metric inexact line-search based methods for nonsmooth optimization

A Proximal-Gradient Method for Constrained Optimization

An interior proximal gradient method for nonconvex optimization

An Alternating Structure-Adapted Bregman Proximal Gradient Descent Algorithm for Constrained Nonconvex Nonsmooth Optimization Problems and Its Inertial Variant.

Projection-Free Non-Smooth Convex Programming

A class of modified accelerated proximal gradient methods for nonsmooth and nonconvex minimization problems

Semi-Proximal Point Method for Nonsmooth Convex-Concave Minimax Optimization

Anisotropic Proximal Gradient

Proximal Point Algorithms for Nonsmooth Convex Optimization with Fixed Point Constraints

A unified single-loop alternating gradient projection algorithm for nonconvex–concave and convex–nonconcave minimax problems

A descent subgradient method using Mifflin line search for nonsmooth nonconvex optimization

A Relative Inexact Proximal Gradient Method With an Explicit Linesearch