Abstract:Complex networks are widespread in real-world environments across diverse domains. Real-world networks tend to form spontaneously through interactions between individual agents. Inspired by this, we design an evolutionary game model in which agents participate in a prisoner’s dilemma game (PDG) with their neighboring agents. Agents can autonomously modify their connections with neighbors using reinforcement learning to avoid unfavorable environments. Interestingly, our findings reveal some remarkable results. Exploiting reinforcement learning-based adaptive networks improves cooperation when juxtaposed with existing PDGs performed on homogeneous networks. At the same time, the network’s topology evolves from homogeneous to heterogeneous states. This change occurs as players gain experience from past games and become more astute in deciding whether to join PDGs with their current neighbors or disconnect from the least profitable neighbors. Instead, they seek out more favorable environments by establishing connections with second-order neighbors with higher rewards. By calculating the degree distribution and modularity of the adaptive network in a steady state, we confirm that the adaptive network follows a power law and has a clear community structure, indicating that the adaptive network is similar to networks in the real world. Our study reports a new phenomenon in evolutionary game theory on networks. It proposes a new perspective to generate scale-free networks, which is generating scale-free networks by the evolution of homogeneous networks rather than typical ways of network growth and preferential connection. Our results provide new aspects to understanding the network structure, the emergence of cooperation, and the behavior of actors in nature and society.

Power-Law Distributed Temporal Heterogeneity of Human Activities Promotes Cooperation on Complex Networks

Impact of Heterogeneous Activities on the Evolution of Cooperation

Impact of Heterogeneous Activity and Community Structure on the Evolutionary Success of Cooperators in Social Networks.

The Effect of Player Participation on the Evolution of Cooperative Behaviors in Scale-free Networks

Evolution of cooperation on reinforcement-learning driven-adaptive networks

Dynamic Prisoner'S Dilemma on Scale-Free Network

Multi-games on Interdependent Networks and the Evolution of Cooperation

Heterogeneous Game Resource Distributions Promote Cooperation in Spatial Prisoner’s Dilemma Game

Evolutionary Prisoner ’ s Dilemma on heterogeneous

Prisoner's Dilemma on Community Networks

The effect of asymmetric payoff mechanism on evolutionary networked prisoner’s dilemma game

Establishing Social Cooperation: the Role of Hubs and Community Structure

Evolutionary prisoners dilemma game with voluntary participation on regular lattices and scale-free networks

The Emergence of Stable Cooperators in Heterogeneous Networked Systems

Impact of Interaction Style and Degree on the Evolution of Cooperation on Barabási-Albert Scale-Free Network.

The Prisoner's Dilemma in Structured Scale-Free Networks

Strategic Games on a Hierarchical Network Model

Evolutionary Prisoner's Dilemma Game on Barabási–Albert Scale-Free Networks

Adaptive Co-Evolution of Strategies and Network Leading to Optimal Cooperation Level in Spatial Prisoner’s Dilemma Game

Promotion of Cooperation in Coevolutionary Public Goods Game on Complex Networks with and without Topology Change

The Prisoner'S Dilemma Game On Scale-Free Networks With Heterogeneous Imitation Capability