Abstract:Complex networks are widespread in real-world environments across diverse domains. Real-world networks tend to form spontaneously through interactions between individual agents. Inspired by this, we design an evolutionary game model in which agents participate in a prisoner’s dilemma game (PDG) with their neighboring agents. Agents can autonomously modify their connections with neighbors using reinforcement learning to avoid unfavorable environments. Interestingly, our findings reveal some remarkable results. Exploiting reinforcement learning-based adaptive networks improves cooperation when juxtaposed with existing PDGs performed on homogeneous networks. At the same time, the network’s topology evolves from homogeneous to heterogeneous states. This change occurs as players gain experience from past games and become more astute in deciding whether to join PDGs with their current neighbors or disconnect from the least profitable neighbors. Instead, they seek out more favorable environments by establishing connections with second-order neighbors with higher rewards. By calculating the degree distribution and modularity of the adaptive network in a steady state, we confirm that the adaptive network follows a power law and has a clear community structure, indicating that the adaptive network is similar to networks in the real world. Our study reports a new phenomenon in evolutionary game theory on networks. It proposes a new perspective to generate scale-free networks, which is generating scale-free networks by the evolution of homogeneous networks rather than typical ways of network growth and preferential connection. Our results provide new aspects to understanding the network structure, the emergence of cooperation, and the behavior of actors in nature and society.

Crossover Between Structured and Well-Mixed Networks in an Evolutionary Prisoner'S Dilemma Game

Coevolution of game and network structure with adjustable linking

The influence of experienced guider on cooperative behavior in the Prisoner's dilemma game

Adaptive Co-Evolution of Strategies and Network Leading to Optimal Cooperation Level in Spatial Prisoner’s Dilemma Game

Multi-games on Interdependent Networks and the Evolution of Cooperation

Evolution of Mixed Strategies on Cooperative Networks

Phase Transition and Hysteresis Loop in Structured Games with Global Updating.

How the Weak and Strong Links Affect the Evolution of Prisoner's Dilemma Game

Evolution of cooperation on reinforcement-learning driven-adaptive networks

Coevolution of game and network structure: The temptation increases the cooperator density

Cooperation Enhanced by the Difference Between Interaction and Learning Neighborhoods for Evolutionary Spatial Prisoner'S Dilemma Games

Promotion of cooperation induced by the interplay between structure and game dynamics

Understanding Cooperative Behavior Based on the Coevolution of Game Strategy and Link Weight

Cooperation Enhanced by the 'survival of the Fittest' Rule in Prisoner'S Dilemma Games on Complex Networks

Dynamics, Morphogenesis and Convergence of Evolutionary Quantum Prisoner's Dilemma Games on Networks

Prisoner's Dilemma on Community Networks

Evolutionary Game on a Stochastic Growth Network

Dynamics, morphogenesis and convergence of evolutionary quantum Prisoner's Dilemma games on networks.

Coevolution Between Strategy and Social Networks Structure Promotes Cooperation

Exploring Social Influence on Evolutionary Prisoner'S Dilemma Games in Networks

Effect of Epidemic Dynamics on Evolutionary Prisoner's Dilemma Game in Scale-Free Networks