Abstract:Much recent research effort has been directed to the development of efficient algorithms for solving minimax problems with theoretical convergence guarantees due to the relevance of these problems to a few emergent applications. In this paper, we propose a unified single-loop alternating gradient projection (AGP) algorithm for solving smooth nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. AGP employs simple gradient projection steps for updating the primal and dual variables alternatively at each iteration. We show that it can find an -stationary point of the objective function in (resp. ) iterations under nonconvex-strongly concave (resp. nonconvex–concave) setting. Moreover, its gradient complexity to obtain an -stationary point of the objective function is bounded by (resp., ) under the strongly convex–nonconcave (resp., convex–nonconcave) setting. To the best of our knowledge, this is the first time that a simple and unified single-loop algorithm is developed for solving both nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. Moreover, the complexity results for solving the latter (strongly) convex–nonconcave minimax problems have never been obtained before in the literature. Numerical results show the efficiency of the proposed AGP algorithm. Furthermore, we extend the AGP algorithm by presenting a block alternating proximal gradient (BAPG) algorithm for solving more general multi-block nonsmooth nonconvex-(strongly) concave and (strongly) convex–nonconcave minimax problems. We can similarly establish the gradient complexity of the proposed algorithm under these four different settings.

A subgradient algorithm for a class of nonlinear split feasibility problems: application to jointly constrained Nash equilibrium models

Modified subgradient extragradient method for solution of split variational inequality problem with application to generalized Nash equilibrium problem

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

Linear Convergence of Subgradient Algorithm for Convex Feasibility on Riemannian Manifolds

Proximal Subgradient Algorithm for a Class of Nonconvex Bilevel Equilibrium Problems

Tseng-type splitting projection algorithms for equilibrium problems in Hilbert spaces

Monotone Splitting SQP Algorithms for Two-block Nonconvex Optimization Problems with General Linear Constraints and Applications

A unified single-loop alternating gradient projection algorithm for nonconvex–concave and convex–nonconcave minimax problems

Accelerated Gradient and Skew-Symmetric Splitting Methods for a Class of Monotone Operator Equations

NE/SQP: A robust algorithm for the nonlinear complementarity problem

A hybrid algorithm for large-scale non-separable nonlinear multicommodity flow problems

A Two-Step Proximal Point Algorithm for Nonconvex Equilibrium Problems with Applications to Fractional Programming

Strong Convergence of an Iterative Method for Solving Generalized Mixed Equilibrium Problems and Split Feasibility Problems

A Gradient-Descent Neurodynamic Approach For Distributed Linear Programming

An effective subgradient algorithm via Mifflin's line search for nonsmooth nonconvex multiobjective optimization

A Strongly Convergent Algorithm for Solving Multiple set Split Equality Equilibrium and Fixed Point Problems in Banach Spaces

NON-CONVEX COMBINATION ALGORITHM FOR A FAMILY OF SPLIT PSEUDOMONOTONE EQUILIBRIUM PROBLEMS IN HILBERT SPACE

Subgradient-based Neural Networks for Nonsmooth Nonconvex Optimization Problems

Halpern inertial subgradient extragradient algorithm for solving equilibrium problems in Banach spaces

An extragradient projection method for strongly quasiconvex equilibrium problems with applications

Mann-Type Inertial Accelerated Subgradient Extragradient Algorithm for Minimum-Norm Solution of Split Equilibrium Problems Induced by Fixed Point Problems in Hilbert Spaces