Abstract:Cooperation as a self-organized collective behavior plays a significant role in the evolution of ecosystems and human society. Reinforcement learning (RL) offers a new perspective, distinct from imitation learning in evolutionary games, for exploring the mechanisms underlying its emergence. However, most existing studies with the public good game (PGG) employ a self-regarding setup or are on pairwise interaction networks. Players in the real world, however, optimize their policies based not only on their histories but also on the histories of their co-players, and the game is played in a group manner. In the work, we investigate the evolution of cooperation in the PGG under the other-regarding reinforcement learning evolutionary game (OR-RLEG) on hypergraph by combining the Q-learning algorithm and evolutionary game framework, where other players' action history is incorporated and the game is played on hypergraphs. Our results show that as the synergy factor increases, the parameter interval is divided into three distinct regions, the absence of cooperation (AC), medium cooperation (MC), and high cooperation (HC), accompanied by two abrupt transitions in the cooperation level near two transition points, respectively. Interestingly, we identify regular and anti-coordinated chessboard structures in the spatial pattern that positively contribute to the first cooperation transition but adversely affect the second. Furthermore, we provide a theoretical treatment for the first transition with an approximated first transition point and reveal that players with a long-sighted perspective and low exploration rate are more likely to reciprocate kindness with each other, thus facilitating the emergence of cooperation. Our findings contribute to understanding the evolution of human cooperation, where other-regarding information and group interactions are commonplace.

Heterogeneous investment promotes cooperation in spatial public goods game on hypergraphs

Cooperation and Charity in Spatial Public Goods Game under Different Strategy Update Rules

Effect of heterogeneous investments on the evolution of cooperation in spatial public goods game.

The spatial public goods game on hypergraphs with heterogeneous investment

Adaptive and Bounded Investment Returns Promote Cooperation in Spatial Public Goods Games

Heterogeneity of allocation promotes cooperation in public goods games

Randomly Biased Investments and the Evolution of Public Goods on Interdependent Networks

Discreet investors exert greater influence on cooperation in the public goods game

Selective Investment Promotes Cooperation in Public Goods Game

The evolution of cooperation in spatial prisoner’s dilemma games with heterogeneous relationships

Dynamic Allocation of Investments Promotes Cooperation in Spatial Public Goods Game

Understanding spatial public goods games on three-layer networks

Particle swarm optimization with historical return decay enhances cooperation in public goods games with investment risks

Inequal dependence on members stabilizes cooperation in spatial public goods game

Heterogeneous interaction radius based on emotional dynamics can promote cooperation in spatial public goods games

Promotion of Cooperation Induced by Nonuniform Payoff Allocation in Spatial Public Goods Game

The Evolution of Cooperation in Spatial Groups

Effect of Heterogeneous Sub-Populations on the Evolution of Cooperation

Cooperation in Public Goods Games: Leveraging Other-Regarding Reinforcement Learning on Hypergraphs

Emergence of Cooperation in Spatial Public Goods Game with Conditional Participation

Does strong heterogeneity promote cooperation by group interactions?