Abstract: Wide machine learning tasks can be formulated as non-convex multi-player games, where Nash equilibrium (NE) is an acceptable solution to all players, since no one can benefit from changing its strategy unilaterally. Attributed to the non-convexity, obtaining the existence condition of global NE is challenging, let alone designing theoretically guaranteed realization algorithms. This paper takes conjugate transformation to the formulation of non-convex multi-player games, and casts the complementary problem into a variational inequality (VI) problem with a continuous pseudo-gradient mapping. We then prove the existence condition of global NE: the solution to the VI problem satisfies a duality relation. Based on this VI formulation, we design a conjugate-based ordinary differential equation (ODE) to approach global NE, which is proved to have an exponential convergence rate. To make the dynamics more implementable, we further derive a discretized algorithm. We apply our algorithm to two typical scenarios: multi-player generalized monotone game and multi-player potential game. In the two settings, we prove that the step-size setting is required to be $\mathcal{O}(1/k)$ and $\mathcal{O}(1/\sqrt k)$ to yield the convergence rates of $\mathcal{O}(1/ k)$ and $\mathcal{O}(1/\sqrt k)$, respectively. Extensive experiments in robust neural network training and sensor localization are in full agreement with our theory.

A multi-player game equilibrium problem based on stochastic variational inequalities

Variational Inequality Approach to Stochastic Nash Equilibrium Problems with an Application to Cournot Oligopoly

Regularized two-stage stochastic variational inequalities for Cournot-Nash equilibrium under uncertainty

Constrained portfolio game with heterogeneous agents

Global Nash Equilibrium in Non-convex Multi-player Game: Theory and Algorithms

Approaching the Global Nash Equilibrium of Non-convex Multi-player Games

Linear convergence in time-varying generalized Nash equilibrium problems

Hierarchical Nash Equilibrium over Variational Equilibria via Fixed-point Set Expression of Quasi-nonexpansive Operator

Equilibrium modeling and solution approaches inspired by nonconvex bilevel programming

Solving Lagrangian variational inequalities with applications to stochastic programming

Nash equilibrium seeking for a class of quadratic-bilinear Wasserstein distributionally robust games

Stochastic User Equilibrium Assignment with Elastic Demand and Its Application

Random games under normal mean–variance mixture distributed independent linear joint chance constraints

A Problem of Calculus of Variations and Game Theory

The solvability and a Stackelberg-Nash game problem for degenerate elliptic equations

Networks in Conflict: A Variational Inequality Approach

Differential Variational Inequality Approach to Dynamic Games with Shared Constraints

Nash equilibrium and bang-bang property for the non-zero-sum differential game of multi-player uncertain systems with Hurwicz criterion

Solving monotone stochastic variational inequalities and complementarity problems by progressive hedging

Games with distributionally robust joint chance constraints

Distributed Optimal Variational GNE Seeking in Merely Monotone Games