Abstract:Complex networks are widespread in real-world environments across diverse domains. Real-world networks tend to form spontaneously through interactions between individual agents. Inspired by this, we design an evolutionary game model in which agents participate in a prisoner’s dilemma game (PDG) with their neighboring agents. Agents can autonomously modify their connections with neighbors using reinforcement learning to avoid unfavorable environments. Interestingly, our findings reveal some remarkable results. Exploiting reinforcement learning-based adaptive networks improves cooperation when juxtaposed with existing PDGs performed on homogeneous networks. At the same time, the network’s topology evolves from homogeneous to heterogeneous states. This change occurs as players gain experience from past games and become more astute in deciding whether to join PDGs with their current neighbors or disconnect from the least profitable neighbors. Instead, they seek out more favorable environments by establishing connections with second-order neighbors with higher rewards. By calculating the degree distribution and modularity of the adaptive network in a steady state, we confirm that the adaptive network follows a power law and has a clear community structure, indicating that the adaptive network is similar to networks in the real world. Our study reports a new phenomenon in evolutionary game theory on networks. It proposes a new perspective to generate scale-free networks, which is generating scale-free networks by the evolution of homogeneous networks rather than typical ways of network growth and preferential connection. Our results provide new aspects to understanding the network structure, the emergence of cooperation, and the behavior of actors in nature and society.

The Emergence of Stable Cooperators in Heterogeneous Networked Systems

Emergence of cooperation in non-scale-free networks

Dynamical Organization of Cooperation on Homogeneous Networked System.

The Emergence of Cooperative Leadership from Homogenous Random Networks

Heterogeneous cooperative leadership structure emerging from random regular graphs.

Evolution of Cooperation on Complex Networks with Synergistic and Discounted Group Interactions

The Different Cooperative Behaviors on a Kind of Scale-Free Networks with Identical Degree Sequence

Cooperation emerged and survived in scale-free networks in co-evolution and betrayer-prevailing circumstances

Does the scale-free topology favor the emergence of cooperation?

Evolution of Cooperation on Heterogeneous Supply Networks

Limitation of network inhomogeneity in improving cooperation in coevolutionary dynamics

Roles of Mixing Patterns in Cooperation on a Scale-Free Networked Game

Diversity-Optimized Cooperation On Complex Networks

Interplay between evolutionary game and network structure: the coevolution of social net, cooperation and wealth

Influence of initial distributions on robust cooperation in evolutionary Prisoner's Dilemma

Evolutionary Prisoner ’ s Dilemma on heterogeneous

Evolution of cooperation in networks with well-connected cooperators

Cooperation Enhanced by the 'survival of the Fittest' Rule in Prisoner'S Dilemma Games on Complex Networks

Evolution of cooperation on reinforcement-learning driven-adaptive networks

Evolution of Cooperation on Stochastic Dynamical Networks

Evolutionary Prisoner's Dilemma on heterogeneous Newman-Watts small-world network