Abstract:Nash Equilibrium (NE) is the canonical solution concept of game theory, which provides an elegant tool to understand the rationalities. Though mixed strategy NE exists in any game with finite players and actions, computing NE in two- or multi-player general-sum games is PPAD-Complete. Various alternative solutions, e.g., Correlated Equilibrium (CE), and learning methods, e.g., fictitious play (FP), are proposed to approximate NE. For convenience, we call these methods as "inexact solvers", or "solvers" for short. However, the alternative solutions differ from NE and the learning methods generally fail to converge to NE. Therefore, in this work, we propose REinforcement Nash Equilibrium Solver (RENES), which trains a single policy to modify the games with different sizes and applies the solvers on the modified games where the obtained solution is evaluated on the original games. Specifically, our contributions are threefold. i) We represent the games as $\alpha$-rank response graphs and leverage graph neural network (GNN) to handle the games with different sizes as inputs; ii) We use tensor decomposition, e.g., canonical polyadic (CP), to make the dimension of modifying actions fixed for games with different sizes; iii) We train the modifying strategy for games with the widely-used proximal policy optimization (PPO) and apply the solvers to solve the modified games, where the obtained solution is evaluated on original games. Extensive experiments on large-scale normal-form games show that our method can further improve the approximation of NE of different solvers, i.e., $\alpha$-rank, CE, FP and PRD, and can be generalized to unseen games.

Cooperative Equilibrium: A solution predicting cooperative play

Distributed Generalized Nash Equilibrium Seeking: An Operator-Theoretic Perspective

A solution concept for games with altruism and cooperation

Safe Equilibrium

Cooperation and self-regulation in a model of agents playing different games

Observable Perfect Equilibrium

Coherence of probabilistic constraints on Nash equilibria

A Unified Perspective on Deep Equilibrium Finding

Turbocharging Solution Concepts: Solving NEs, CEs and CCEs with Neural Equilibrium Solvers

Social Optimum Equilibrium Selection for Distributed Multi-Agent Optimization

Reinforcement Nash Equilibrium Solver

Constrained Phi-Equilibria

On the Complexity of Cooperative Solution Concepts.

Satisficing Equilibrium

Nash Equilibrium in Games on Graphs with Incomplete Preferences

A Robust Characterization of Nash Equilibrium

Achieving Correlated Equilibrium by Studying Opponent's Behavior Through Policy-Based Deep Reinforcement Learning

Nash Equilibrium Seeking for Incomplete Cluster Game in the Cooperation–Competition Network

M Equilibrium: A theory of beliefs and choices in games

Optimal Correlated Equilibria in General-Sum Extensive-Form Games: Fixed-Parameter Algorithms, Hardness, and Two-Sided Column-Generation

Implementations of Cooperative Games Under Non-Cooperative Solution Concepts