Abstract:Much recent research effort has been directed to the development of efficient algorithms for solving minimax problems with theoretical convergence guarantees due to the relevance of these problems to a few emergent applications. In this paper, we propose a unified single-loop alternating gradient projection (AGP) algorithm for solving smooth nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. AGP employs simple gradient projection steps for updating the primal and dual variables alternatively at each iteration. We show that it can find an -stationary point of the objective function in (resp. ) iterations under nonconvex-strongly concave (resp. nonconvex–concave) setting. Moreover, its gradient complexity to obtain an -stationary point of the objective function is bounded by (resp., ) under the strongly convex–nonconcave (resp., convex–nonconcave) setting. To the best of our knowledge, this is the first time that a simple and unified single-loop algorithm is developed for solving both nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. Moreover, the complexity results for solving the latter (strongly) convex–nonconcave minimax problems have never been obtained before in the literature. Numerical results show the efficiency of the proposed AGP algorithm. Furthermore, we extend the AGP algorithm by presenting a block alternating proximal gradient (BAPG) algorithm for solving more general multi-block nonsmooth nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. We can similarly establish the gradient complexity of the proposed algorithm under these four different settings.

A GENERALIZED GRADIENT PROJECTION ALGORITHM FOR MATHEMATICAL PROGRAM WITH COMPLEMENTARITY CONSTRAINTS

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

PROJECTION ALGORITHMS FOR CONVEX FEASIBILITY PROBLEMS ON HADAMARD MANIFOLDS

Gradient Projection Method for Optimization Problems with a Constraint in the Form of the Intersection of a Smooth Surface and a Convex Closed Set

Iterative algorithms for equilibrium problems based on proximal-like methods

Subgradient Projection Algorithms for Convex Feasibility on Riemannian Manifolds with Lower Bounded Curvatures

A unified single-loop alternating gradient projection algorithm for nonconvex–concave and convex–nonconcave minimax problems

Random Multi-Constraint Projection: Stochastic Gradient Methods for Convex Optimization with Many Constraints

Modified Projection Method For General Variational Inequalities

A class modified projection algorithms for nonmonotone variational inequalities with continuity

Sign projected gradient flow: A continuous-time approach to convex optimization with linear equality constraints

The projected-type method for the extended vertical linear complementarity problem revisited

Stochastic Nonlinear Complementarity Problems: Stochastic Programming Reformulation and Penalty-Based Approximation Method

Convergence Properties of Modified and Partially-Augmented Lagrangian Methods for Mathematical Programs with Complementarity Constraints

A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations

Linear Regularity and Linear Convergence of Projection-Based Methods for Solving Convex Feasibility Problems

A Class of Modified Generalized Quasi-Newton Algorithms for Solving Complementarity Problem

An extragradient projection method for strongly quasiconvex equilibrium problems with applications

Generalized Gradient Projection Neural Networks for Nonsmooth Optimization Problems

Projection iterative method for solving general variational inequalities

Projection-Free Non-Smooth Convex Programming