Abstract:Computing Nash equilibrium in multi-agent games is a longstanding challenge at the interface of game theory and computer science. It is well known that a general normal form game in N players and k strategies requires exponential space simply to write down. This Curse of Multi-Agents prompts the study of succinct games which can be written down efficiently. A canonical example of a succinct game is the graphical game which models players as nodes in a graph interacting with only their neighbors in direct analogy with markov random fields. Graphical games have found applications in wireless, financial, and social networks. However, computing the nash equilbrium of graphical games has proven challenging. Even for polymatrix games, a model where payoffs to an agent can be written as the sum of payoffs of interactions with the agent's neighbors, it has been shown that computing an epsilon approximate nash equilibrium is PPAD hard for epsilon smaller than a constant. The focus of this work is to circumvent this computational hardness by considering average case graph models i.e random graphs. We provide a quasipolynomial time approximation scheme (QPTAS) for computing an epsilon approximate nash equilibrium of polymatrix games on random graphs with edge density greater than poly(k, 1/epsilon, ln(N))$ with high probability. Furthermore, with the same runtime we can compute an epsilon-approximate Nash equilibrium that epsilon-approximates the maximum social welfare of any nash equilibrium of the game. Our primary technical innovation is an "accelerated rounding" of a novel hierarchical convex program for the nash equilibrium problem. Our accelerated rounding also yields faster algorithms for Max-2CSP on the same family of random graphs, which may be of independent interest.

Accelerating Nash Q-Learning with Graphical Game Representation and Equilibrium Solving

Convergence Analysis of Graphical Game-Based Nash Q−Learning Using the Interaction Detection Signal of N−Step Return

Dynamic channel selection in unknown environment based on graphical game and multi-Q learning

Multi-Agent Trajectory Prediction Based on Graph Neural Network

A novel multi-agent Q-learning algorithm in cooperative multi-agent system

Multi-Agent Game Abstraction Via Graph Attention Neural Network.

Cooperative Path Following Control in Autonomous Vehicles Graphical Games: A Data-Based Off-Policy Learning Approach

Approximating Nash Equilibrium in Random Graphical Games

A Formal Model for Multiagent Q-Learning Dynamics on Regular Graphs.

A Distributed Q-Learning Algorithm for Multi-Agent Team Coordination

Hypergraph-Based Model for Modelling Multi-agent Q-Learning Dynamics in Public Goods Games

Graph-QMIX: Addressing the Partial Observation Issues Via Graph Neural Network in Multi-Agent Reinforcement Learning

Nash equilibrium of multi-agent graphical game with a privacy information encrypted learning algorithm

Learning Graphon Mean Field Games and Approximate Nash Equilibria

Graph MADDPG with RNN for multiagent cooperative environment

Learning in Multi-Agent Systems with Sparse Interactions by Knowledge Transfer and Game Abstraction

Asymptotic Convergence and Performance of Multi-Agent Q-Learning Dynamics

Resolving Implicit Coordination in Multi-Agent Deep Reinforcement Learning with Deep Q-Networks & Game Theory

Meta-game equilibrium for multi-agent reinforcement learning

Efficient use of heuristics for accelerating XCS-based policy learning in Markov games

Empirical Policy Optimization for n-Player Markov Games