Abstract:In evolutionary game theory , the emergence and maintenance of cooperative behavior in a population often face challenges posed by the temptation of free-riding behavior, which offers high individual payoff. Recently, apart from a range of mechanisms that promote the formation of cooperation, individual learning abilities under limited information have emerged as a key factor in adjusting agents' strategies. This paper introduces q-learning and particle swarm optimization into the realm of evolutionary dynamics. The primary focus is on investigating the impact of Exploration-based Particle Swarm Optimization (EPSO) and Q-learning-based Particle Swarm Optimization (QPSO) on the evolution of cooperation in a continuous version of the spatial public goods game (SPGG) with punishment. EPSO defines a rule for updating agents' strategies based on individual and limited population information. It also integrates an exploration mechanism to increase the diversity and directionality of the strategies. Additionally, QPSO serves to adaptively optimize the parameters of EPSO, addressing the issue of parameter control limiting the EPSO's performance. Leveraging experiential learning and iterative adjustment, QPSO progressively refines system parameters, thus rationally assimilating knowledge and updating individual strategies to attain optimal payoff. Through extensive simulation studies, it has been observed that employing QPSO's adaptively optimized parameters in EPSO significantly promotes the cooperative evolution in the SPGG with punishment. Furthermore, individual learning coefficients, when too low or too high, both facilitate the occurrence of cooperation. Simultaneously, higher inertia weight coefficients strengthen the system's cooperation level, while lower punishment intensity coefficients and higher gain intensity coefficients effectively promote the cooperation emergence and exert a significant influence on the overall cooperation level of the system. This research provides a new perspective for designing real-world schemes that encourage cooperation and offers insights into the intricate dynamics of cooperation in complex systems.

Evolutionary Learning of Multiagents Using Strategic Coalition in the IPD Game

Evolutionary Game Dynamics of Multi-Agent Cooperation Driven by Self-Learning

Learning Intra-group Cooperation in Multi-agent Systems.

Multi-Agent Evolutionary Reinforcement Learning Based on Cooperative Games

Evolutionary Multi-agent Reinforcement Learning in Group Social Dilemmas

An Adaptive Strategy Via Reinforcement Learning for the Prisoner's Dilemma Game

Towards Cooperation in Sequential Prisoner's Dilemmas: a Deep Multiagent Reinforcement Learning Approach

Evolutionary Dynamics of Population Games With an Aspiration-Based Learning Rule

A Strategy Adaptive Evolution Approach Based on the Public Goods Game

Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum Games

Birds of a Feather Flock Together: A Close Look at Cooperation Emergence via Multi-Agent RL

Evolutionary game dynamics of multi-agent systems using local information considering hide right

Aspiration-driven co-evolution of cooperation with individual behavioral diversity

A study of factors in the formation of population game cooperation based on mixed learning rules

Learning enables adaptation in cooperation for multi-player stochastic games

Evolution of cooperation on reinforcement-learning driven-adaptive networks

Exploring Dominant Strategies in Iterated and Evolutionary Games: a Multi-Agent Reinforcement Learning Approach

A New Decentralized Approach of Multiagent Cooperative Pursuit Based on the Iterated Elimination of Dominated Strategies Model

Enhancing cooperative evolution in spatial public goods game by particle swarm optimization based on exploration and q-learning

Online Learning in Iterated Prisoner's Dilemma to Mimic Human Behavior

Oscillatory evolution of collective behavior in evolutionary games played with reinforcement learning