Abstract:Much recent research effort has been directed to the development of efficient algorithms for solving minimax problems with theoretical convergence guarantees due to the relevance of these problems to a few emergent applications. In this paper, we propose a unified single-loop alternating gradient projection (AGP) algorithm for solving smooth nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. AGP employs simple gradient projection steps for updating the primal and dual variables alternatively at each iteration. We show that it can find an -stationary point of the objective function in (resp. ) iterations under nonconvex-strongly concave (resp. nonconvex–concave) setting. Moreover, its gradient complexity to obtain an -stationary point of the objective function is bounded by (resp., ) under the strongly convex–nonconcave (resp., convex–nonconcave) setting. To the best of our knowledge, this is the first time that a simple and unified single-loop algorithm is developed for solving both nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. Moreover, the complexity results for solving the latter (strongly) convex–nonconcave minimax problems have never been obtained before in the literature. Numerical results show the efficiency of the proposed AGP algorithm. Furthermore, we extend the AGP algorithm by presenting a block alternating proximal gradient (BAPG) algorithm for solving more general multi-block nonsmooth nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. We can similarly establish the gradient complexity of the proposed algorithm under these four different settings.

A Conjugate Projection Gradient Algorithm for Nonlinear Constrained Optimization

A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations

The convergence of conjugate gradient method with nonmonotone line search

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

O(log T) Projections for Stochastic Optimization of Smooth and Strongly Convex Functions

Efficient Projected Gradient Methods for L 0 Constrained Optimization

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

Efficient Projected Gradient Methods for Cardinality Constrained Optimization

A unified single-loop alternating gradient projection algorithm for nonconvex–concave and convex–nonconcave minimax problems

Global Convergence of the Polak-Ribière and Hestenes-Stiefel Conjugate Gradient Methods for the Unconstrained Nonlinear Optimization

A derivative-free memoryless BFGS hyperplane projection method for solving large-scale nonlinear monotone equations

A Conjugate Gradient Method with Global Convergence for Large-Scale Unconstrained Optimization Problems

Linear Convergence Results for Inertial Type Projection Algorithm for Quasi-Variational Inequalities

Convergence Analysis of a Projected Gradient Method for Multiobjective Optimization Problems

A Proximal-Gradient Method for Constrained Optimization

A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing

A Modified Conjugacy Condition And Related Nonlinear Conjugate Gradient Method

On the convergence of the gradient projection method for convex optimal control problems with bang–bang solutions

Sign projected gradient flow: A continuous-time approach to convex optimization with linear equality constraints

Gradient Projection Method for Optimization Problems with a Constraint in the Form of the Intersection of a Smooth Surface and a Convex Closed Set