Abstract:Direct reciprocity based on the repeated prisoner's dilemma has been intensively studied. Most theoretical investigations have concentrated on memory-$1$ strategies, a class of elementary strategies just reacting to the previous-round outcomes. Though the properties of "All-or-None" strategies ($AoN_K$) have been discovered, simulations just confirmed the good performance of $AoN_K$ of very short memory lengths. It remains unclear how $AoN_K$ strategies would fare when players have access to longer rounds of history information. We construct a theoretical model to investigate the performance of the class of $AoN_K$ strategies of varying memory length $K$. We rigorously derive the payoffs and show that $AoN_K$ strategies of intermediate memory length $K$ are most prevalent, while strategies of larger memory lengths are less competent. Larger memory lengths make it hard for $AoN_K$ strategies to coordinate, and thus inhibiting their mutual reciprocity. We then propose the adaptive coordination strategy combining tolerance and $AoN_K$' coordination rule. This strategy behaves like $AoN_K$ strategy when coordination is not sufficient, and tolerates opponents' occasional deviations by still cooperating when coordination is sufficient. We found that the adaptive coordination strategy wins over other classic memory-$1$ strategies in various typical competition environments, and stabilizes the population at high levels of cooperation, suggesting the effectiveness of high level adaptability in resolving social dilemmas. Our work may offer a theoretical framework for exploring complex strategies using history information, which are different from traditional memory-$n$ strategies.

Memory-n strategies of direct reciprocity

Conditional cooperation with longer memory

Adaptive dynamics of direct reciprocity with N rounds of memory

Comparing reactive and memory-one strategies of direct reciprocity

Evolution of reciprocity with limited payoff memory

Adaptive coordination promotes collective cooperation in repeated social dilemmas

Memory as a cognitive requirement for reciprocal cooperation

Memory-based Spatial Evolutionary Prisoner’s Dilemma

Indirect reciprocity with simple records

Short Memory-Based Human Strategy Modeling in Social Dilemmas

Small games and long memories promote cooperation

Using a theory of mind to find best responses to memory-one strategies

Memory-two zero-determinant strategies in repeated games

Memory-two strategies forming symmetric mutual reinforcement learning equilibrium in repeated prisoners' dilemma game

The implicit cognition of reciprocal exchange: automatic retrieval of positive and negative experiences with partners in a prisoner's dilemma game

The role of memory in transition from direct to indirect reciprocity

One step memory of group reputation is optimal to promote cooperation in public goods games

Memory Size, Learning and Dynamic Preferential Selection in the Spatial Prisoner's Dilemma Game

Evolution of All-or-None Strategies in Repeated Public Goods Dilemmas

Dynamics of heuristics selection for cooperative behaviour