Abstract:Complex networks are widespread in real-world environments across diverse domains. Real-world networks tend to form spontaneously through interactions between individual agents. Inspired by this, we design an evolutionary game model in which agents participate in a prisoner’s dilemma game (PDG) with their neighboring agents. Agents can autonomously modify their connections with neighbors using reinforcement learning to avoid unfavorable environments. Interestingly, our findings reveal some remarkable results. Exploiting reinforcement learning-based adaptive networks improves cooperation when juxtaposed with existing PDGs performed on homogeneous networks. At the same time, the network’s topology evolves from homogeneous to heterogeneous states. This change occurs as players gain experience from past games and become more astute in deciding whether to join PDGs with their current neighbors or disconnect from the least profitable neighbors. Instead, they seek out more favorable environments by establishing connections with second-order neighbors with higher rewards. By calculating the degree distribution and modularity of the adaptive network in a steady state, we confirm that the adaptive network follows a power law and has a clear community structure, indicating that the adaptive network is similar to networks in the real world. Our study reports a new phenomenon in evolutionary game theory on networks. It proposes a new perspective to generate scale-free networks, which is generating scale-free networks by the evolution of homogeneous networks rather than typical ways of network growth and preferential connection. Our results provide new aspects to understanding the network structure, the emergence of cooperation, and the behavior of actors in nature and society.

Evolution of Innovative Behaviors on Scale-Free Networks

Modeling for the Dynamics of Human Innovative Behaviors

A Hybrid Mechanism for Innovation Diffusion in Social Networks.

Dynamic Evolution of Knowledge Sharing Behavior among Enterprises in the Cluster Innovation Network Based on Evolutionary Game Theory

Evolutionary Game Simulation of Knowledge Transfer in Industry-University-Research Cooperative Innovation Network under Different Network Scales

Evolutionary Game Analysis of Knowledge Sharing in Low-Carbon Innovation Network

Impact of Social Reward on the Evolution of the Cooperation Behavior in Complex Networks

Modeling and Simulation of Knowledge Innovation Diffusion in Weighted Scale-free Industry-University-Research Cooperative Innovation Network

Research on the diffusion of green innovation behavior based on complex network evolutionary game

Structural Evolution Features of Collaborative Innovation Network of College Students from the Perspective of Knowledge Flow

Evolutionary Dynamics of Information Diffusion over Social Networks

Temporal Evolution of Social Innovation

Evolutionary Information Diffusion over Social Networks

Research on Game Model of Technical Innovation Diffusion

Modeling information diffusion dynamics over social networks

Graphical Evolutionary Game for Information Diffusion over Social Networks.

The Effect of Player Participation on the Evolution of Cooperative Behaviors in Scale-free Networks

Multi-parameter models of innovation diffusion on complex networks

The effect of network structure on innovation initiation process: an evolutionary dynamics approach

Evolution of cooperation on reinforcement-learning driven-adaptive networks

Learning and Innovation Expand Cooperative Network Topologies