Abstract:Recent advances at the intersection of dense large graph limits and mean field games have begun to enable the scalable analysis of a broad class of dynamical sequential games with large numbers of agents. So far, results have been largely limited to graphon mean field systems with continuous-time diffusive or jump dynamics, typically without control and with little focus on computational methods. We propose a novel discrete-time formulation for graphon mean field games as the limit of non-linear dense graph Markov games with weak interaction. On the theoretical side, we give extensive and rigorous existence and approximation properties of the graphon mean field solution in sufficiently large systems. On the practical side, we provide general learning schemes for graphon mean field equilibria by either introducing agent equivalence classes or reformulating the graphon mean field system as a classical mean field system. By repeatedly finding a regularized optimal control solution and its generated mean field, we successfully obtain plausible approximate Nash equilibria in otherwise infeasible large dense graph games with many agents. Empirically, we are able to demonstrate on a number of examples that the finite-agent behavior comes increasingly close to the mean field behavior for our computed equilibria as the graph or system size grows, verifying our theory. More generally, we successfully apply policy gradient reinforcement learning in conjunction with sequential Monte Carlo methods.

Stochastic Graphon Mean Field Games with Jumps and Approximate Nash Equilibria

Convergence Dynamics of Graphical Congestion Games.

Stochastic Graphon Games: I. The Static Case

Stochastic Graphon Games with Memory

Learning Graphon Mean Field Games and Approximate Nash Equilibria

Graphon Mean Field Games with a Representative Player: Analysis and Learning Algorithm

Propagation of Chaos of Forward-Backward Stochastic Differential Equations with Graphon Interactions

Graphon games: A statistical framework for network games and interventions

Linear-Quadratic Graphon Mean Field Games with Common Noise

Stationary Mean Field Games on networks with sticky transition conditions

Graphon Particle Systems, Part I: Spatio-Temporal Approximation and Law of Large Numbers

Accuracy of the Graphon Mean Field Approximation for Interacting Particle Systems

Linear-quadratic Mean-Field Game for Stochastic Large-Population Systems with Jump Diffusion

Graphon Particle Systems, Part II: Dynamics of Distributed Stochastic Continuum Optimization

Non-parametric estimates for graphon mean-field particle systems

Ε-Nash Mean-Field Games for Linear-Quadratic Systems with Random Jumps and Applications.

Mean-Field Limits for Stochastic Interacting Particles on Digraph Measures

Stochastic Stability Analysis of Evolutionary Two-Player Games on Regular Graphs

Mean-Field Games with common Poissonian noise: a Maximum Principle approach

Master equations for finite state mean field games with nonlinear activations

Finite-Agent Stochastic Differential Games on Large Graphs: I. The Linear-Quadratic Case