Dynamic Population Games: A Tractable Intersection of Mean-Field Games and Population Games

Ezzat Elokda,Saverio Bolognani,Andrea Censi,Florian Dörfler,Emilio Frazzoli
DOI: https://doi.org/10.1109/LCSYS.2024.3406947
2024-06-04
Abstract:In many real-world large-scale decision problems, self-interested agents have individual dynamics and optimize their own long-term payoffs. Important examples include the competitive access to shared resources (e.g., roads, energy, or bandwidth) but also non-engineering domains like epidemic propagation and control. These problems are natural to model as mean-field games. Existing mathematical formulations of mean field games have had limited applicability in practice, since they require solving non-standard initial-terminal-value problems that are tractable only in limited special cases. In this letter, we propose a novel formulation, along with computational tools, for a practically relevant class of Dynamic Population Games (DPGs), which correspond to discrete-time, finite-state-and-action, stationary mean-field games. Our main contribution is a mathematical reduction of Stationary Nash Equilibria (SNE) in DPGs to standard Nash Equilibria (NE) in static population games. This reduction is leveraged to guarantee the existence of a SNE, develop an evolutionary dynamics-based SNE computation algorithm, and derive simple conditions that guarantee stability and uniqueness of the SNE. We provide two examples of applications: fair resource allocation with heterogeneous agents and control of epidemic propagation. Open source software for SNE computation: <a class="link-external link-https" href="https://gitlab.ethz.ch/elokdae/dynamic-population-games" rel="external noopener nofollow">this https URL</a>
Optimization and Control,Computer Science and Game Theory,Theoretical Economics,Systems and Control
What problem does this paper attempt to address?
This paper mainly discusses Dynamic Population Games (DPGs), which is a model that combines mean field games and population games and is applicable to large-scale decision-making problems, especially in real scenarios such as resource competition and infectious disease control. Existing mean field game theory faces computational challenges in practical applications and requires solving non-standard initial-terminal value problems, which are only feasible in specific cases. The paper proposes a new mathematical formalization method for dynamic population games, especially for static mean field games with discrete time, finite states, and actions. The main contribution of the authors is to simplify the Static Nash Equilibrium (SNE) in this game into the Standard Nash Equilibrium (NE) in static population games. Through this simplification, they can ensure the existence of SNE and develop an SNE calculation algorithm based on evolutionary dynamics, while providing simple conditions to ensure the stability and uniqueness of SNE. The paper provides two application examples, one being fair resource allocation with heterogeneous agents, and the other being the spread and control of infectious diseases. The authors also provide an open-source software for SNE calculation. This work extends the intersection between population games and mean field games, providing new tools and analytical methods for solving equilibrium problems in complex systems.