Tuning Cooperative Behavior in Games with Nonlinear Opinion Dynamics

Shinkyu Park,Anastasia Bizyaeva,Mari Kawakatsu,Alessio Franci,Naomi Ehrich Leonard

DOI: https://doi.org/10.48550/arXiv.2108.00966

2021-11-23

Abstract:We examine the tuning of cooperative behavior in repeated multi-agent games using an analytically tractable, continuous-time, nonlinear model of opinion dynamics. Each modeled agent updates its real-valued opinion about each available strategy in response to payoffs and other agent opinions, as observed over a network. We show how the model provides a principled and systematic means to investigate behavior of agents that select strategies using rationality and reciprocity, key features of human decision-making in social dilemmas. For two-strategy games, we use bifurcation analysis to prove conditions for the bistability of two equilibria and conditions for the first (second) equilibrium to reflect all agents favoring the first (second) strategy. We prove how model parameters, e.g., level of attention to opinions of others (reciprocity), network structure, and payoffs, influence dynamics and, notably, the size of the region of attraction to each stable equilibrium. We provide insights by examining the tuning of the bistability of mutual cooperation and mutual defection and their regions of attraction for the repeated prisoner's dilemma and the repeated multi-agent public goods game. Our results generalize to games with more strategies, heterogeneity, and additional feedback dynamics, such as those designed to elicit cooperation.

Physics and Society,Multiagent Systems,Social and Information Networks,Dynamical Systems,Optimization and Control

What problem does this paper attempt to address?

This paper attempts to solve the problem of how to adjust cooperative behavior through the nonlinear opinion dynamics model in repeated multi - agent games. Specifically, the paper focuses on how to use an analytically feasible, nonlinear opinion dynamics model to study the behavior patterns of agents when choosing strategies based on the principles of rationality and reciprocity in a continuous - time framework. The core of the paper lies in showing how this model provides a systematic method to explore the behavior of agents, especially those human decision - making processes that exhibit rationality and reciprocity characteristics in social dilemmas.

### Main Contributions
1. **New Framework**: A new framework for studying cooperative behavior in repeated multi - agent games is proposed, which is based on the nonlinear opinion dynamics model. In this model, the strategic decisions of agents depend not only on payoffs but also on social interactions in which they can observe other agents' strategy preferences.
2. **Bistable Conditions**: For two - strategy games, the bistable conditions of two equilibrium points are proven, as well as the conditions under which each equilibrium point reflects all agents' preference for a certain strategy. The proof of these conditions relies on bifurcation analysis and shows how model parameters (such as the degree of attention to others' opinions, network structure, and payoffs) affect dynamic behavior and the size of the attraction region of each stable equilibrium point.

### Application Examples
- **Repeated Prisoner's Dilemma**: By analyzing the opinion dynamics model, the paper explores how reciprocity promotes mutual cooperation or coordination, especially in the repeated prisoner's Dilemma. The results show that when agents pay enough attention to social interactions, mutual cooperation can be promoted.
- **Multi - agent Public Goods Game**: Similarly, in the multi - agent public goods game, the paper explores how cooperative behavior emerges through social interactions (i.e., reciprocity) and analyzes how the possibility of cooperation is affected by the initial opinion state, network structure, and total wealth.

### Numerical Simulations
- **Prisoner's Dilemma**: The cooperation probabilities under different initial opinion states are shown through numerical simulations, verifying the theoretical predictions. The results show that when agents initially have a high preference for cooperation, they can maintain cooperation by "forgiving" the other party's inappropriate behavior even if the other party initially adopts a non - cooperative attitude.
- **Public Goods Game**: By changing the network structure, initial opinion state, and total wealth, this paper explores how these factors affect the emergence of cooperative behavior. The results show that when the interaction frequency between agents is high and they are initially inclined to cooperate, cooperation is more likely to be sustained.

### Conclusions
The paper provides an analytically feasible framework through the nonlinear opinion dynamics model for studying cooperative behavior in multi - agent repeated games based on rationality and reciprocity. This model not only explains how reciprocity promotes stable cooperative behavior but also provides a systematic method to adjust cooperative behavior, which has been verified in experimental studies. Future work will further design feedback dynamic mechanisms to reflect agents' gradually increasing attention to social interactions, thereby affecting their behavior, such as promoting cooperation or coordination.