Abstract:We initiate the study of game dynamics in the population protocol model: $n$ agents each maintain a current local strategy and interact in pairs uniformly at random. Upon each interaction, the agents play a two-person game and receive a payoff from an underlying utility function, and they can subsequently update their strategies according to a fixed local algorithm. In this setting, we ask how the distribution over agent strategies evolves over a sequence of interactions, and we introduce a new distributional equilibrium concept to quantify the quality of such distributions. As an initial example, we study a class of repeated prisoner's dilemma games, and we consider a family of simple local update algorithms that yield non-trivial dynamics over the distribution of agent strategies. We show that these dynamics are related to a new class of high-dimensional Ehrenfest random walks, and we derive exact characterizations of their stationary distributions, bounds on their mixing times, and prove their convergence to approximate distributional equilibria. Our results highlight trade-offs between the local state space of each agent, and the convergence rate and approximation factor of the underlying dynamics. Our approach opens the door towards the further characterization of equilibrium computation for other classes of games and dynamics in the population setting.

What problem does this paper attempt to address?

This paper discusses the problem of game dynamics and equilibrium computation in a population protocol model. In this model, each agent maintains a local policy and interacts randomly in pairs. After each interaction, agents play a game and receive rewards based on a base utility function, and then they may update their policies according to a fixed local algorithm. The focus of the study is how the distribution of agent policies evolves over time and how to define and quantify the concept of equilibrium for this distribution. The authors introduce a new concept called Distributional Equilibrium (DE) to measure the quality of this distribution. As a starting point, they study a class of repeated Prisoner's Dilemma games and consider a set of simple local update algorithms that generate non-trivial dynamics of policy distribution. They relate these dynamics to a class of high-dimensional weighted Ehrenfest random walks and accurately characterize their stationary distribution, mixing time, and convergence to approximate distributional equilibrium. The results highlight the trade-off between the convergence rate and approximation factor of the individual agent's state space and the underlying dynamics. The main contributions of the paper include the definition of an Incremental Generosity Tuning (IGT) dynamics, the proof of its convergence to an approximate distributional equilibrium under certain conditions, and the quantification of its convergence rate and approximation factor. The study also reveals that the time required to reach equilibrium increases linearly with an increase in the strategy parameter space and the local state requirement for each GTFT agent, but the approximation factor decreases at a rate of 1/k. Related work in the paper covers various areas, such as population protocol dynamics, evolutionary game dynamics, computational complexity of equilibrium computation, and multi-player game settings, but it does not focus on quantitative aspects related to mixing time or convergence time. The technical tools employed in the paper include the association of k-IGT dynamics with a new high-dimensional weighted Ehrenfest random walk, which may be of independent interest for understanding and analyzing the stationarity and mixing time of the new process.

Game Dynamics and Equilibrium Computation in the Population Protocol Model

Distributed Population Dynamics for Searching Generalized Nash Equilibria of Population Games with Graphical Strategy Interactions

Dynamic Population Games: A Tractable Intersection of Mean-Field Games and Population Games

The emergence of chaos in population game dynamics induced by comparisons

Learning Equilibrium with Estimated Payoffs in Population Games

Computation and Simulation of Evolutionary Game Dynamics in Finite Populations.

Population games on dynamic community networks

Evolutionary Game Dynamics for Two Interacting Populations in A Co-evolving Environment.

Dynamic Properties of Evolutionary Multi-player Games in Finite Populations

Learning, evolution and population dynamics

Population dynamics with a stable efficient equilibrium

Evolutionary Games on Infinite Strategy Sets: Convergence to Nash Equilibria via Dissipativity

Equilibria of Dynamic Games with Many Players: Existence, Approximation, and Market Structure

Population Games and Discrete Optimal Transport

Stochastic Dynamics of Division of Labor Games in Finite Populations

Continuous Game Dynamics on Populations with a Cycle Structure under Weak Selection

Consensus-Based Multipopulation Game Dynamics for Distributed Nash Equilibria Seeking and Optimization

On the population size in stochastic differential games

Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

Learning with Delayed Payoffs in Population Games using Kullback-Leibler Divergence Regularization

Dynamics, morphogenesis and convergence of evolutionary quantum Prisoner's Dilemma games on networks.