Abstract:Using simulations between pairs of $\epsilon$-greedy q-learners with one-period memory, this article demonstrates that the potential function of the stochastic replicator dynamics (Foster and Young, 1990) allows it to predict the emergence of error-proof cooperative strategies from the underlying parameters of the repeated prisoner's dilemma. The observed cooperation rates between q-learners are related to the ratio between the kinetic energy exerted by the polar attractors of the replicator dynamics under the grim trigger strategy. The frontier separating the parameter space conducive to cooperation from the parameter space dominated by defection can be found by setting the kinetic energy ratio equal to a critical value, which is a function of the discount factor, $f(\delta) = \delta/(1-\delta)$, multiplied by a correction term to account for the effect of the algorithms' exploration probability. The gradient at the frontier increases with the distance between the game parameters and the hyperplane that characterizes the incentive compatibility constraint for cooperation under grim trigger. Building on literature from the neurosciences, which suggests that reinforcement learning is useful to understanding human behavior in risky environments, the article further explores the extent to which the frontier derived for q-learners also explains the emergence of cooperation between humans. Using metadata from laboratory experiments that analyze human choices in the infinitely repeated prisoner's dilemma, the cooperation rates between humans are compared to those observed between q-learners under similar conditions. The correlation coefficients between the cooperation rates observed for humans and those observed for q-learners are consistently above $0.8$. The frontier derived from the simulations between q-learners is also found to predict the emergence of cooperation between humans.

Emergence of cooperation in the one-shot Prisoner's dilemma through Discriminatory and Samaritan AIs

Discriminatory or Samaritan -- which AI is needed for humanity? An Evolutionary Game Theory Analysis of Hybrid Human-AI populations

Emergence and resilience of cooperation in the spatial prisoner's dilemma via a reward mechanism

On the Emergence of Cooperation in the Repeated Prisoner's Dilemma

Small Bots, Big Impact: Solving the Conundrum of Cooperation in Optional Prisoner's Dilemma Game through Simple Strategies

The Emergence of Cooperation in the well-mixed Prisoner's Dilemma: Memory Couples Individual and Group Strategies

Multi-Agent, Human-Agent and Beyond: A Survey on Cooperation in Social Dilemmas

Birds of a Feather Flock Together: A Close Look at Cooperation Emergence via Multi-Agent RL

Cooperation in the spatial prisoner's dilemma game with probabilistic abstention

Emergent Cooperation under Uncertain Incentive Alignment

A solution concept for games with altruism and cooperation

Popularity-Based Approach to Promote Cooperation in The Prisoner's Dilemma Game

The Optional Prisoner's Dilemma in a Spatial Environment: Coevolving Game Strategy and Link Weights

Evolutionary Games and Computer Simulations

Engineering Optimal Cooperation Levels with Prosocial Autonomous Agents in Hybrid Human-Agent Populations: An Agent-Based Modeling Approach

On the coexistence of cooperators, defectors and conditional cooperators in the multiplayer iterated Prisoner's Dilemma

Cooperation in costly-access environments

Interaction Stochasticity Supports Cooperation in Spatial Prisoner's Dilemma.

Artificial Intelligence & Cooperation

Prisoner's dilemma game on adaptive networks under limited foresight

Hunting for wealthy encounters promotes cooperation in spatial Prisoner’s Dilemma games