Abstract:The framework of iterated Prisoner's Dilemma (IPD) is commonly used to study direct reciprocity and cooperation, with a focus on the assessment of the generosity and reciprocal fairness of an IPD strategy in one-on-one settings. In order to understand the persistence and resilience of reciprocal cooperation, here we study long-term population dynamics of IPD strategies using the Moran process where stochastic dynamics of strategy competition can lead to the rise and fall of cooperation. Although prior work has included a handful of typical IPD strategies in the consideration, it remains largely unclear which type of IPD strategies is pivotal in steering the population away from defection and providing an escape hatch for establishing cooperation. We use a network-based approach to analyze and characterize networks of evolutionary pathways that bridge transient episodes of evolution dominated by depressing defection and ultimately catalyze the evolution of reciprocal cooperation in the long run. We group IPD strategies into three types according to their stationary cooperativity with an unconditional cooperator: the good (fully cooperative), the bad (fully exploitive), and the ugly (in between the former two types). We consider the mutation-selection equilibrium with rare mutations and quantify the impact of the presence versus absence of any given IPD strategy on the resulting population equilibrium. We identify catalysts (certain IPD strategies) as well as bridges (particular evolutionary pathways) that are most crucial for boosting the abundance of good types and suppressing that of bad types or having the highest betweenness centrality. Our work has practical implications and broad applicability to real-world cooperation problems by leveraging catalysts and bridges that are capable of strengthening persistence and resilience.

Why More Choices Cause Less Cooperation In Iterated Prisoner'S Dilemma

The collapse of cooperation in evolving games

Evolution of Cooperation in Prisoner's Dilemma within Changeable External Environments

The Iterated Prisoner's Dilemma: Good Strategies and Their Dynamics

Cooperation in the iterated prisoner's dilemma is learned by operant conditioning mechanisms

Cooperation in the Finitely Repeated Prisoner's Dilemma

Iterated Prisoner’s Dilemma contains strategies that dominate any evolutionary opponent

From extortion to generosity, the evolution of zero-determinant strategies in the prisoner's dilemma

Prisoner's dilemma game on adaptive networks under limited foresight

Extortion outperforms generosity in iterated Prisoners' Dilemma

Predicting Human Cooperation

Evolution of cooperation with the diversity of cooperation tendencies

Identifying Bridges and Catalysts for Persistent Cooperation Using Network-Based Approach

How evolution affects network reciprocity in Prisoner's Dilemma

Exit rights open complex pathways to cooperation

Evolutionary consequences of behavioral diversity

Perfect reciprocity is the only evolutionarily stable strategy in the continuous iterated prisoner's dilemma

Intrinsic fluctuations of reinforcement learning promote cooperation

The evolution of cooperation

Evolution of extortion in Iterated Prisoner’s Dilemma games

Evolution of Interactions and Cooperation in the Spatial Prisoner's Dilemma Game