Abstract:Cooperation as a self-organized collective behavior plays a significant role in the evolution of ecosystems and human society. Reinforcement learning (RL) offers a new perspective, distinct from imitation learning in evolutionary games, for exploring the mechanisms underlying its emergence. However, most existing studies with the public good game (PGG) employ a self-regarding setup or are on pairwise interaction networks. Players in the real world, however, optimize their policies based not only on their histories but also on the histories of their co-players, and the game is played in a group manner. In the work, we investigate the evolution of cooperation in the PGG under the other-regarding reinforcement learning evolutionary game (OR-RLEG) on hypergraph by combining the Q-learning algorithm and evolutionary game framework, where other players' action history is incorporated and the game is played on hypergraphs. Our results show that as the synergy factor increases, the parameter interval is divided into three distinct regions, the absence of cooperation (AC), medium cooperation (MC), and high cooperation (HC), accompanied by two abrupt transitions in the cooperation level near two transition points, respectively. Interestingly, we identify regular and anti-coordinated chessboard structures in the spatial pattern that positively contribute to the first cooperation transition but adversely affect the second. Furthermore, we provide a theoretical treatment for the first transition with an approximated first transition point and reveal that players with a long-sighted perspective and low exploration rate are more likely to reciprocate kindness with each other, thus facilitating the emergence of cooperation. Our findings contribute to understanding the evolution of human cooperation, where other-regarding information and group interactions are commonplace.

Evolutionary Game Analysis and Enlightenment of Social Cooperation in Public Electronic Reading Room

Cooperation and Charity in Spatial Public Goods Game under Different Strategy Update Rules

Evolutionary game analysis on cooperative behaviors of internet service providers

Evolution and simulation analysis of co-opetition behavior of E-business internet platform based on evolutionary game theory

Evolution of cooperation in the public goods game with Q-learning

Evolution of Cooperation in Spatio-Temporal Evolutionary Games with Public Goods Feedback

Research on Cooperative Behavior of Green Technology Innovation in Construction Enterprises Based on Evolutionary Game

Structure Based Design of CYP51 Inhibitors.

The Evolution Game Analysis of Platform Ecological Collaborative Governance Considering Collaborative Cultural Context

Eco-evolutionary dynamics with environmental feedback: Cooperation in a changing world

Evolution of cooperation in the multigame on a two-layer square network

Social Dilemmas in an Online Social Network: the Structure and Evolution of Cooperation

Coevolution of Strategy and Structure on Social Networks

A Tripartite Evolutionary Game Analysis of Online Knowledge Sharing Community

A Strategy Adaptive Evolution Approach Based on the Public Goods Game

Evolutionary Dynamics Of Public Goods Games With Diverse Contributions In Finite Populations

Cooperation in Public Goods Games: Leveraging Other-Regarding Reinforcement Learning on Hypergraphs

Cooperation in Evolutionary Games on Complex Networks.

The Evolution of Cooperation in Spatial Groups

Coevolving agent strategies and network topology for the public goods games

Evolutionary Self-Questioning Games with Local Contribution