Abstract:Complex networks are widespread in real-world environments across diverse domains. Real-world networks tend to form spontaneously through interactions between individual agents. Inspired by this, we design an evolutionary game model in which agents participate in a prisoner’s dilemma game (PDG) with their neighboring agents. Agents can autonomously modify their connections with neighbors using reinforcement learning to avoid unfavorable environments. Interestingly, our findings reveal some remarkable results. Exploiting reinforcement learning-based adaptive networks improves cooperation when juxtaposed with existing PDGs performed on homogeneous networks. At the same time, the network’s topology evolves from homogeneous to heterogeneous states. This change occurs as players gain experience from past games and become more astute in deciding whether to join PDGs with their current neighbors or disconnect from the least profitable neighbors. Instead, they seek out more favorable environments by establishing connections with second-order neighbors with higher rewards. By calculating the degree distribution and modularity of the adaptive network in a steady state, we confirm that the adaptive network follows a power law and has a clear community structure, indicating that the adaptive network is similar to networks in the real world. Our study reports a new phenomenon in evolutionary game theory on networks. It proposes a new perspective to generate scale-free networks, which is generating scale-free networks by the evolution of homogeneous networks rather than typical ways of network growth and preferential connection. Our results provide new aspects to understanding the network structure, the emergence of cooperation, and the behavior of actors in nature and society.

Evolutionary dynamics of N-player sender-receiver game in networks with community structure

Evolutionary Dynamics Drives Role Specialization in a Community of Players

Evolutionary Game Dynamics of Multiagent Systems on Multiple Community Networks.

Impact of Social Reward on the Evolution of the Cooperation Behavior in Complex Networks

Evolutionary Dynamics and Individual Heterogeneity in Multi-Agent Networking Systems

Evolutionary game dynamics with environmental feedback in a network with two communities

Collective Behaviors And Self-Organizing Cooperation

Evolutionary dynamics of cooperation on interdependent networks with Prisoner's Dilemma and Snowdrift Game

Evolutionary Game Dynamics of the Competitive Information Propagation on Social Networks.

Evolutionary Dynamics of Cooperation on Interdependent Networks with the Prisoner's Dilemma and Snowdrift Game

Towards the Role of Social Connectivity and Aspiration Level on Evolutionary Game

Evolutionary dynamics in stochastic nonlinear public goods games

The Evolution of Cooperation in Public Goods Games on Signed Networks

Impact of Heterogeneous Activity and Community Structure on the Evolutionary Success of Cooperators in Social Networks.

Higher-order Temporal Interactions Promote the Cooperation in the Multiplayer Snowdrift Game

An Evolutionary Game Model of Multi-Topics Diffusion in Social Network

A Survey of Evolutionary Game Theory on Complex Networks

Evolution of cooperation on reinforcement-learning driven-adaptive networks

Evolutionary Dynamics of Cooperation with the Celebrity Effect in Complex Networks.

Cooperative evolution with opinion formation in a complex social environment