Abstract:Evolutionary game dynamics on networks typically consider the competition among simple strategies such as cooperation and defection in the Prisoner's Dilemma and summarize the effect of population structure as network reciprocity. However, it remains largely unknown regarding the evolutionary dynamics involving multiple powerful strategies typically considered in repeated games, such as the zero-determinant (ZD) strategies that are able to enforce a linear payoff relationship between them and their co-players. Here, we consider the evolutionary dynamics of always cooperate (AllC), extortionate ZD (extortioners), and unbending players in lattice populations based on the commonly used death-birth updating. Out of the class of unbending strategies, we consider a particular candidate, PSO Gambler, a machine-learning-optimized memory-one strategy, which can foster reciprocal cooperation and fairness among extortionate players. We derive analytical results under weak selection and rare mutations, including pairwise fixation probabilities and long-term frequencies of strategies. In the absence of the third unbending type, extortioners can achieve a half-half split in equilibrium with unconditional cooperators for sufficiently large extortion factors. However, the presence of unbending players fundamentally changes the dynamics and tilts the system to favor unbending cooperation. Most surprisingly, extortioners cannot dominate at all regardless of how large their extortion factor is, and the long-term frequency of unbending players is maintained almost as a constant. Our analytical method is applicable to studying the evolutionary dynamics of multiple strategies in structured populations. Our work provides insights into the interplay between network reciprocity and direct reciprocity, revealing the role of unbending strategies in enforcing fairness and suppressing extortion.

Single Equalizer Strategy with no Information Transfer for Conflict Escalation

Evolutionary dynamics of zero-determinant strategies in repeated multiplayer games

Equalizer zero-determinant strategy in discounted repeated Stackelberg asymmetric game

Unbending strategies shepherd cooperation and suppress extortion in spatial populations

Win-Stay-Lose-Shift as a self-confirming equilibrium in the iterated Prisoner's Dilemma

Zero-determinant strategies in iterated multi-strategy games

Evolutionary consequences of behavioral diversity

Win-Stay-Lose-Shift as a self-confirming equilibrium in the iterated Prisoner’s Dilemma

From extortion to generosity, the evolution of zero-determinant strategies in the prisoner's dilemma

The intricate geometry of zero-determinant strategies underlying evolutionary adaptation from extortion to generosity

Linear algebraic structure of zero-determinant strategies in repeated games

The Iterated Prisoner's Dilemma: Good Strategies and Their Dynamics

Iterated Prisoner’s Dilemma contains strategies that dominate any evolutionary opponent

Evolution of extortion in Iterated Prisoner’s Dilemma games

Recognising and evaluating the effectiveness of extortion in the Iterated Prisoner's Dilemma

Zero-Determinant Strategies in the Iterated Public Goods Game

Reentrant phase transitions and defensive alliances in social dilemmas with informed strategies

Steering control of payoff-maximizing players in adaptive learning dynamics

Mixed strategy approach destabilizes cooperation in finite populations with clustering coefficient

Evolutionary instability of Zero Determinant strategies demonstrates that winning isn't everything