Abstract:Abstract Emerging reinforcement learning algorithms that utilize human traits as part of their conceptual architecture have been demonstrated to encourage cooperation in social dilemmas when compared to their unaltered origins. In particular, the addition of a mood mechanism facilitates more cooperative behaviour in multi-agent iterated prisoner dilemma (IPD) games, for both static and dynamic network contexts. Mood-altered agents also exhibit humanlike behavioural trends when environmental aspects of the dilemma are altered, such as the structure of the payoff matrix used. It is possible that other environmental effects from both human and agent-based research will interact with moody structures in previously unstudied ways. As the literature on these interactions is currently small, we seek to expand on previous research by introducing two more environmental dimensions; voluntary interaction in dynamic networks, and stability of interaction through varied network restructuring. From an initial Erdos–Renyi random network, we manipulate the structure of a network IPD according to existing methodology in human-based research, to investigate possible replication of their findings. We also facilitated strategic selection of opponents through the introduction of two partner evaluation mechanisms and tested two selection thresholds for each. We found that even minimally strategic play termination in dynamic networks is enough to enhance cooperation above a static level, though the thresholds for these strategic decisions are critical to desired outcomes. More forgiving thresholds lead to better maintenance of cooperation between kinder strategies than stricter ones, despite overall cooperation levels being relatively low. Additionally, moody reinforcement learning combined with certain play termination decision strategies can mimic trends in human cooperation affected by structural changes to the IPD played on dynamic networks—as can kind and simplistic strategies such as Tit-For-Tat. Implications of this in comparison with human data is discussed, and suggestions for diversification of further testing are made.

Humans display a reduced set of consistent behavioral phenotypes in dyadic games

Evolutionary Dynamics Drives Role Specialization in a Community of Players

Humans display a ‘cooperative phenotype’that is domain general and temporally stable

Cooperation and competition between pair and multi-player social games in spatial populations

Evolutionary consequences of behavioral diversity

Dynamics of heuristics selection for cooperative behaviour

A Model of Risk and Mental State Shifts during Social Interaction

Short Memory-Based Human Strategy Modeling in Social Dilemmas

Predicting Human Behavior Toward Members of Different Social Groups.

Predicting human behavior in unrepeated, simultaneous-move games

COGNITION AND BEHAVIOR IN TWO-PERSON GUESSING GAMES: AN EXPERIMENTAL STUDY1

Predicting Human Cooperation

Co-evolution of Behaviour and Beliefs in Social Dilemmas: Estimating Material, Social, Cognitive and Cultural Determinants

Heterogeneous networks do not promote cooperation when humans play a Prisoner’s Dilemma

To qualify as a social partner, humans hide severe punishment, although their observed cooperativeness is decisive

Cognitive mechanisms for human flocking dynamics

Cooperate or aggress? An opponent's tendency to cooperate modulates the neural dynamics of interpersonal cooperation

‘ I don’t want to play with you anymore ’: dynamic partner judgements in moody reinforcement learners playing the prisoner’s dilemma

Individualistic attitudes in Iterated Prisoner's Dilemma undermine evolutionary fitness and may drive cooperative human players to extinction

The Evolution of Behavior Strategies among Typical Games

Learning dynamics explains human behavior in Prisoner's Dilemma on networks