Abstract:Complex networks are widespread in real-world environments across diverse domains. Real-world networks tend to form spontaneously through interactions between individual agents. Inspired by this, we design an evolutionary game model in which agents participate in a prisoner’s dilemma game (PDG) with their neighboring agents. Agents can autonomously modify their connections with neighbors using reinforcement learning to avoid unfavorable environments. Interestingly, our findings reveal some remarkable results. Exploiting reinforcement learning-based adaptive networks improves cooperation when juxtaposed with existing PDGs performed on homogeneous networks. At the same time, the network’s topology evolves from homogeneous to heterogeneous states. This change occurs as players gain experience from past games and become more astute in deciding whether to join PDGs with their current neighbors or disconnect from the least profitable neighbors. Instead, they seek out more favorable environments by establishing connections with second-order neighbors with higher rewards. By calculating the degree distribution and modularity of the adaptive network in a steady state, we confirm that the adaptive network follows a power law and has a clear community structure, indicating that the adaptive network is similar to networks in the real world. Our study reports a new phenomenon in evolutionary game theory on networks. It proposes a new perspective to generate scale-free networks, which is generating scale-free networks by the evolution of homogeneous networks rather than typical ways of network growth and preferential connection. Our results provide new aspects to understanding the network structure, the emergence of cooperation, and the behavior of actors in nature and society.

Replicator Dynamics of Co-Evolving Networks

A New Mathematical Model for Evolutionary Games on Finite Networks of Players

Nested replicator dynamics, nested logit choice, and similarity-based learning

Co-evolutionary games on networks

Evolutionary Dynamics On Stochastic Evolving Networks For Multiple-Strategy Games

Generalized Hamiltonian Dynamics and Chaos in Evolutionary Games on Networks

The replicator equation on graphs

Replicator Equation: Applications Revisited

A game-theoretical dynamic imitation model on networks

Coevolution of strategies and update rules in the Prisoner's Dilemma game on complex networks

On the discrete-time origins of the replicator dynamics: From convergence to instability and chaos

Efficient Evolutionary Dynamics with Extensive-Form Games

Graphical Nash Equilibria and Replicator Dynamics on Complex Networks.

Coevolutionary dynamics of networks and games under birth-death and birth mechanisms

Evolutionary Game in A Single Hub Structure

Population games on dynamic community networks

Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum Games

Evolutionary games and the emergence of complex networks

Evolution of cooperation on reinforcement-learning driven-adaptive networks

Imitation dynamics and the replicator equation

Evolutionary network games: equilibria from imitation and best-response dynamics