Abstract:Abstract Emerging reinforcement learning algorithms that utilize human traits as part of their conceptual architecture have been demonstrated to encourage cooperation in social dilemmas when compared to their unaltered origins. In particular, the addition of a mood mechanism facilitates more cooperative behaviour in multi-agent iterated prisoner dilemma (IPD) games, for both static and dynamic network contexts. Mood-altered agents also exhibit humanlike behavioural trends when environmental aspects of the dilemma are altered, such as the structure of the payoff matrix used. It is possible that other environmental effects from both human and agent-based research will interact with moody structures in previously unstudied ways. As the literature on these interactions is currently small, we seek to expand on previous research by introducing two more environmental dimensions; voluntary interaction in dynamic networks, and stability of interaction through varied network restructuring. From an initial Erdos–Renyi random network, we manipulate the structure of a network IPD according to existing methodology in human-based research, to investigate possible replication of their findings. We also facilitated strategic selection of opponents through the introduction of two partner evaluation mechanisms and tested two selection thresholds for each. We found that even minimally strategic play termination in dynamic networks is enough to enhance cooperation above a static level, though the thresholds for these strategic decisions are critical to desired outcomes. More forgiving thresholds lead to better maintenance of cooperation between kinder strategies than stricter ones, despite overall cooperation levels being relatively low. Additionally, moody reinforcement learning combined with certain play termination decision strategies can mimic trends in human cooperation affected by structural changes to the IPD played on dynamic networks—as can kind and simplistic strategies such as Tit-For-Tat. Implications of this in comparison with human data is discussed, and suggestions for diversification of further testing are made.

Forgiveness is an Adaptation in Iterated Prisoner's Dilemma with Memory

Moving on or deciding to let go? A pathway exploring the relationship between emotional and decisional forgiveness and intentional forgetting.

Adaptive coordination promotes collective cooperation in repeated social dilemmas

Using a theory of mind to find best responses to memory-one strategies

Invincible Strategies of Iterated Prisoner's Dilemma

Putting revenge and forgiveness in an evolutionary context

Properties of Winning Iterated Prisoner's Dilemma Strategies

The Evolution of Cooperation with Memory, Learning and Dynamic Preferential Selection in Spatial Prisoner's Dilemma Game

Online Learning in Iterated Prisoner's Dilemma to Mimic Human Behavior

Adaptive exit facilitates the evolution of cooperation in the spatial prisoner's dilemma game with punishment

Disinhibited Revenge – An fNIRS Study on Forgiveness and Cognitive Control

Memory Size, Learning and Dynamic Preferential Selection in the Spatial Prisoner's Dilemma Game

Recognising and evaluating the effectiveness of extortion in the Iterated Prisoner's Dilemma

Cooperation, Retaliation and Forgiveness in Revision Games

Third-party arbitration and forgiving strategies increase cooperation when perception errors are common

Beyond Reciprocity: Forgiveness, Generosity, and Punishment in Continuing Dyadic Interactions

The Emergence of Cooperation in the well-mixed Prisoner's Dilemma: Memory Couples Individual and Group Strategies

Evolution of reciprocity with limited payoff memory

Behavioural strategies in simultaneous and alternating prisoner's dilemma games with/without voluntary participation

‘ I don’t want to play with you anymore ’: dynamic partner judgements in moody reinforcement learners playing the prisoner’s dilemma

Cooperation in the Finitely Repeated Prisoner's Dilemma