Electronic supplementary material for "spatial reciprocity in the evolution of cooperation" from Spatial reciprocity in the evolution of cooperation

Qi Su,Aming Li,Long Wang,H. Eugene Stanley

2019-01-01

Abstract:Analytical calculations and supplementary data for "spatial reciprocity in the evolution of cooperation"

What problem does this paper attempt to address?

Cooperation and Charity in Spatial Public Goods Game under Different Strategy Update Rules

Yixiao Li,Xiaogang Jin,Xianchuang Su,Fansheng Kong,Chengbin Peng

DOI: https://doi.org/10.1016/j.physa.2009.11.010

2010-01-01

Abstract:Human cooperation can be influenced by other human behaviors and recent years have witnessed the flourishing of studying the coevolution of cooperation and punishment, yet the common behavior of charity is seldom considered in game-theoretical models. In this article, we investigate the coevolution of altruistic cooperation and egalitarian charity in spatial public goods game, by considering charity as the behavior of reducing inter-individual payoff differences. Our model is that, in each generation of the evolution, individuals play games first and accumulate payoff benefits, and then each egalitarian makes a charity donation by payoff transfer in its neighborhood. To study the individual-level evolutionary dynamics, we adopt different strategy update rules and investigate their effects on charity and cooperation. These rules can be classified into two global rules: random selection rule in which individuals randomly update strategies, and threshold selection rule where only those with payoffs below a threshold update strategies. Simulation results show that random selection enhances the cooperation level, while threshold selection lowers the threshold of the multiplication factor to maintain cooperation. When charity is considered, it is incapable in promoting cooperation under random selection, whereas it promotes cooperation under threshold selection. Interestingly, the evolution of charity strongly depends on the dispersion of payoff acquisitions of the population, which agrees with previous results. Our work may shed light on understanding human egalitarianism.
Spatial reciprocity in the evolution of cooperation.

Qi Su,Aming Li,Long Wang,H Eugene Stanley

DOI: https://doi.org/10.1098/rspb.2019.0041

2019-01-01

Abstract:Cooperation is key to the survival of all biological systems. The spatial structure of a system constrains who interacts with whom (interaction partner) and who acquires new traits from whom (role model). Understanding when and to what degree a spatial structure affects the evolution of cooperation is an important and challenging topic. Here, we provide an analytical formula to predict when natural selection favours cooperation where the effects of a spatial structure are described by a single parameter. We find that a spatial structure promotes cooperation (spatial reciprocity) when interaction partners overlap role models. When they do not, spatial structure inhibits cooperation even without cooperation dilemmas. Furthermore, a spatial structure in which individuals interact with their role models more often shows stronger reciprocity. Thus, imitating individuals with frequent interactions facilitates cooperation. Our findings are applicable to both pairwise and group interactions and show that strong social ties might hinder, while asymmetric spatial structures for interaction and trait dispersal could promote cooperation.
Evolution of Cooperation in Spatio-Temporal Evolutionary Games with Public Goods Feedback

Haihui Cheng,Liubov Sysoeva,Hao Wang,Hairui Yuan,Tonghua Zhang,Xinzhu Meng

DOI: https://doi.org/10.1007/s11538-024-01296-y

2024-05-08

Bulletin of Mathematical Biology

Abstract:In biology, evolutionary game-theoretical models often arise in which players' strategies impact the state of the environment, driving feedback between strategy and the surroundings. In this case, cooperative interactions can be applied to studying ecological systems, animal or microorganism populations, and cells producing or actively extracting a growth resource from their environment. We consider the framework of eco-evolutionary game theory with replicator dynamics and growth-limiting public goods extracted by population members from some external source. It is known that the two sub-populations of cooperators and defectors can develop spatio-temporal patterns that enable long-term coexistence in the shared environment. To investigate this phenomenon and unveil the mechanisms that sustain cooperation, we analyze two eco-evolutionary models: a well-mixed environment and a heterogeneous model with spatial diffusion. In the latter, we integrate spatial diffusion into replicator dynamics. Our findings reveal rich strategy dynamics, including bistability and bifurcations, in the temporal system and spatial stability, as well as Turing instability, Turing–Hopf bifurcations, and chaos in the diffusion system. The results indicate that effective mechanisms to promote cooperation include increasing the player density, decreasing the relative timescale, controlling the density of initial cooperators, improving the diffusion rate of the public goods, lowering the diffusion rate of the cooperators, and enhancing the payoffs to the cooperators. We provide the conditions for the existence, stability, and occurrence of bifurcations in both systems. Our analysis can be applied to dynamic phenomena in fields as diverse as human decision-making, microorganism growth factors secretion, and group hunting.

mathematical & computational biology,biology
Spatial Structure Favors Cooperative Behavior in the Snowdrift Game with Multiple Interactive Dynamics

Qi Su,Aming Li,Long Wang

DOI: https://doi.org/10.1016/j.physa.2016.10.095

IF: 3.778

2016-01-01

Physica A Statistical Mechanics and its Applications

Abstract:Spatial reciprocity is generally regarded as a positive rule facilitating the evolution of cooperation. However, a few recent studies show that, in the snowdrift game, spatial structure still could be detrimental to cooperation. Here we propose a model of multiple interactive dynamics, where each individual can cooperate and defect simultaneously against different neighbors. We realize individuals’ multiple interactions simply by endowing them with strategies relevant to probabilities, and every one decides to cooperate or defect with a probability. With multiple interactive dynamics, the cooperation level in square lattices is higher than that in the well-mixed case for a wide range of cost-to-benefit ratio r, implying that spatial structure favors cooperative behavior in the snowdrift game. Moreover, in square lattices, the most favorable strategy follows a simple relation of r, which confers theoretically the average evolutionary frequency of cooperative behavior. We further extend our study to various homogeneous and heterogeneous networks, which demonstrates the robustness of our results. Here multiple interactive dynamics stabilizes the positive role of spatial structure on the evolution of cooperation and individuals’ distinct reactions to different neighbors can be a new line in understanding the emergence of cooperation.
Evolution of cooperation with asymmetric social interactions

Qi Su,Benjamin Allen,Joshua B Plotkin,Joshua B. Plotkin

DOI: https://doi.org/10.1073/pnas.2113468118

IF: 11.1

2021-12-30

Proceedings of the National Academy of Sciences

Abstract:Significance Humans have a remarkable, but not ubiquitous, tendency toward altruism. This behavior reflects a classic enigma in evolutionary theory: When and why would individuals forgo selfish interests to help strangers? Population structure is known to catalyze cooperation because it enables local reciprocity—I help you, and you help me. But this explanation assumes bidirectional social interactions, whereas human interactions are often unidirectional: One individual has the opportunity to contribute altruistically to another, but not conversely. Here we uncover a surprising result, that directionality can actually facilitate cooperation. We study this effect theoretically and also in empirical social networks. We suggest several practical implications, including how to modify the directions of social interactions to promote cooperation.
The Evolution of Cooperation in Spatial Groups

Jianlei Zhang,Chunyan Zhang,Tianguang Chu

DOI: https://doi.org/10.1016/j.chaos.2011.01.002

2011-01-01

Abstract:Much of human cooperation remains an evolutionary riddle. There is evidence that individuals are often organized into groups in many social situations. Inspired by this observation, we propose a simple model of evolutionary public goods games in which individuals are organized into networked groups. Here, nodes in the network represent groups; the edges, connecting the nodes, refer to the interactions between the groups. Individuals establish public goods games with partners in the same group and migrate among neighboring groups depending on their payoffs and expectations. We show that the paradigmatic public goods social dilemma can be resolved and high cooperation levels are attained in structured groups, even in relatively harsh conditions for cooperation. Further, by means of numerical simulations and mean-field analysis, we arrive at the result: larger average group size and milder cooperation environment would lead to lower cooperation level but higher average payoffs of the entire population. Altogether, these results emphasize that our understanding of cooperation can be enhanced by investigations of how spatial groups of individuals affect the evolution dynamics, which might help in explaining the emergence and evolution of cooperation.
Numerical and Analytical Study of Evolution of Indirect Reciprocity

X Cheng,Q Ouyang

DOI: https://doi.org/10.1016/s0378-4371(02)00969-x

2002-01-01

Abstract:The evolution of indirect reciprocity by images scoring proposed by Nowak and Sigmund is systematically studied with numerical simulations and theoretical analysis. Two different types of evolutionary stable societies, cooperative and defective, can be found in that model. Our study reveals important influences of the information on the society. First, the information exchange rate can determine the type of the society. A society with high information exchange rate prefers a cooperative state, while society with low information exchange rate remains in a defective state. Second, it affects the ability of a society to resist the mutation. An analytical approach using information theory is presented, which catches certain features observed in the numerical simulation.
Emergence of Cooperation in Spatial Public Goods Game with Conditional Participation

Ming Li,Chun-Xiao Jia,Run-Ran Liu,Bing-Hong Wang

DOI: https://doi.org/10.1016/j.physa.2012.12.022

2013-01-01

Abstract:Conditional interactions are common in both human and animal societies. To understand the impacts of this feature on the evolution of cooperation, we propose a modified public goods game combined with conditional interactions in terms of the aspiration payoffs. Through simulations, we find that the function of the fraction of cooperators and the synergy factor is non-monotonic. This indicates that a large synergy factor is not always in favor of the promotion of cooperation. In addition, for a high aspiration, the typical coexistence state of cooperators and defectors could disappear, and the system demonstrates a sharp transition from the complete defection state to the complete cooperation state as the synergy factor increases. Furthermore, an interesting critical phenomenon is found in a finite system, i.e., the system can randomly evolve into a complete defection state or a complete cooperation state. An explanation of these evolutionary outcomes is provided in this paper, which is in agreement with the simulation results. (C) 2013 Elsevier B.V. All rights reserved.
Dynamical reciprocity in interacting games: Numerical results and mechanism analysis

Rizhou Liang,Qinqin Wang,Jiqiang Zhang,Guozhong Zheng,Lin Ma,Li Chen

DOI: https://doi.org/10.1103/PhysRevE.105.054302

IF: 2.707

2022-05-04

Physical Review E

Abstract:We study the evolution of two mutually interacting pairwise games on different topologies. On two-dimensional square lattices, we reveal that the game-game interaction can promote the cooperation prevalence in all cases, and the cooperation-defection phase transitions even become absent and fairly high cooperation is expected when the interaction becomes very strong. A mean-field theory is developed that points out dynamical routes arising therein. Detailed analysis shows indeed that there are rich categories of interactions in either the individual or bulk scenario: invasion, neutral, and catalyzed types; their combination puts cooperators at a persistent advantage position, which boosts the cooperation. The robustness of the revealed reciprocity is strengthened by the studies of model variants, including the public goods game, asymmetrical or time-varying interactions, games of different types, games with timescale separation, different updating rules, etc. The structural complexities of the underlying population, such as Newman-Watts small world networks, Erdős-Rényi random networks, and Barabási-Albert networks, also do not alter the working of the dynamical reciprocity. In particular, as the number of games engaged increases, the cooperation level continuously improves in general. However, our analysis shows that the dynamical reciprocity works only in structured populations, otherwise the game-game interaction has no any impact on the cooperation at all. In brief, our work uncovers a cooperation mechanism in the structured populations, which indicates the great potential for human cooperation since concurrent issues are so often seen in the real world. https://doi.org/10.1103/PhysRevE.105.054302 ©2022 American Physical Society

physics, fluids & plasmas, mathematical
Cooperation in evolutionary games incorporated with extended Q-learning algorithm

Pinduo Long,Qionglin Dai,Haihong Li,Junzhong Yang

DOI: https://doi.org/10.1142/s0129183124502048

2024-08-20

International Journal of Modern Physics C

Abstract:International Journal of Modern Physics C, Ahead of Print. Evolutionary game theory provides a platform to investigate the emergence of cooperation in population consisting of selfish agents. In this work, we study evolutionary games on networks in which agents cooperate or defect according to Q-learning algorithms with extended state space. Extended state space provides agents two types of information, local environment information based on the cooperation level in agents' neighborhood and personal information based on the last action of agents. Through numerical simulations, we find that rich information on local environment tends to improve cooperation in the population no matter whether personal information is present or not. Moreover, we show that, for the same local environment information, the introduction of personal information may improve cooperation except for the situations with low amount of local environment information where personal information deteriorates cooperation in bad-condition environment. For the same total information, the absence of personal information promotes cooperation in bad-condition environment while the presence of personal information promotes cooperation in good-condition environment. By investigating the distributions and temporal behaviors of Q-values, we present explanations for the above statements. This work suggests an effective way of extending the state space in evolutionary games incorporated with Q-learning algorithm to enhance cooperation.

physics, mathematical,computer science, interdisciplinary applications
Agent-based evolutionary game dynamics uncover the dual role of resource heterogeneity in the evolution of cooperation

Qin Yang,Yi Tang,Dehua Gao

DOI: https://doi.org/10.1016/j.jtbi.2024.111952

2024-09-24

Abstract:Cooperation is a cornerstone of social harmony and group success. Environmental feedbacks that provide information about resource availability play a crucial role in encouraging cooperation. Previous work indicates that the impact of resource heterogeneity on cooperation depends on the incentive to act in self-interest presented by a situation, demonstrating its potential to both hinder and facilitate cooperation. However, little is known about the underlying evolutionary drivers behind this phenomenon. Leveraging agent-based modeling and game theory, we explore how differences in resource availability across environments influence the evolution of cooperation. Our results show that resource variation hinders cooperation when resources are slowly replenished but supports cooperation when resources are more readily available. Furthermore, simulations in different scenarios suggest that discerning the rate of natural selection acts on strategies under distinct evolutionary dynamics is instrumental in elucidating the intricate nexus between resource variability and cooperation. When evolutionary forces are strong, resource heterogeneity tends to work against cooperation, yet relaxed selection conditions enable it to facilitate cooperation. Inspired by these findings, we also propose a potential application in improving the performance of artificial intelligence systems through policy optimization in multi-agent reinforcement learning. These explorations promise a novel perspective in understanding the evolution of social organisms and the impact of different interactions on the function of natural systems.
The evolution of cooperation in spatial prisoner’s dilemma games with heterogeneous relationships

Bo Xu,Miao Li,Ruipu Deng

DOI: https://doi.org/10.1016/j.physa.2015.01.028

2015-01-01

Abstract:This paper investigates how the introduction of heterogeneous relationships and the subsequent investment preference influences the evolution of cooperation in prisoner’s dilemma games. We consider random tie strength values drawn from distributions with different heterogeneity. We show that cooperation is significantly promoted if players preferentially allocate their investments to the friends with strong relationships. The facilitation of cooperation relies mostly on the heterogeneous distribution of relationships and the subsequent investment preference, resulting in strong cooperative allies between good friends and the formation of cooperative clusters around such allies. Moreover, we discover that the investment preference has a sophisticated impact on the evolution of cooperation. Consequently, the level of cooperation will be greatly enhanced by a weak investment preference, but will be significantly depressed if such preference exceeds a critical value. We attribute this finding to the extreme allocation of investments brought by strong preference that hinders the diffusion of cooperative strategy all over the network. Our results suggest that heterogeneous relationships and the subsequent investment preference might have played a crucial role by the evolution of cooperation amongst egoistic individuals.
Spatial alignment, group strategy and non-kin selection enable the evolution of cooperation

Xiaoliang Wang,Andrew Harrison

DOI: https://doi.org/10.48550/arXiv.2103.11925

2021-04-07

Abstract:This article considers a mechanism to explain the emergence and evolution of social cooperation. Selfish individuals tend to benefit themselves, which makes it hard for the maintenance of cooperation between unrelated individuals. We propose and validate that a smart group strategy can effectively facilitate the evolution of cooperation, provided cooperators spatially align whilst cooperating at a new level of alliance. The general evolutionary model presented here shows that a non-kin selection effect is a possible cause for cooperation between unrelated individuals and highlights that non-kin selection may be a hallmark of biological evolution.

Populations and Evolution
Effect of heterogeneous investments on the evolution of cooperation in spatial public goods game.

Keke Huang,Tao Wang,Yuan Cheng,Xiaoping Zheng

DOI: https://doi.org/10.1371/journal.pone.0120317

IF: 3.7

2015-01-01

PLoS ONE

Abstract:Understanding the emergence of cooperation in spatial public goods game remains a grand challenge across disciplines. In most previous studies, it is assumed that the investments of all the cooperators are identical, and often equal to 1. However, it is worth mentioning that players are diverse and heterogeneous when choosing actions in the rapidly developing modern society and researchers have shown more interest to the heterogeneity of players recently. For modeling the heterogeneous players without loss of generality, it is assumed in this work that the investment of a cooperator is a random variable with uniform distribution, the mean value of which is equal to 1. The results of extensive numerical simulations convincingly indicate that heterogeneous investments can promote cooperation. Specifically, a large value of the variance of the random variable can decrease the two critical values for the result of behavioral evolution effectively. Moreover, the larger the variance is, the better the promotion effect will be. In addition, this article has discussed the impact of heterogeneous investments when the coevolution of both strategy and investment is taken into account. Comparing the promotion effect of coevolution of strategy and investment with that of strategy imitation only, we can conclude that the coevolution of strategy and investment decreases the asymptotic fraction of cooperators by weakening the heterogeneity of investments, which further demonstrates that heterogeneous investments can promote cooperation in spatial public goods game.
Effect of Heterogeneous Sub-Populations on the Evolution of Cooperation

Keke Huang,Xiaoping Zheng,Yunpeng Su

DOI: https://doi.org/10.1016/j.amc.2015.08.057

IF: 4.397

2015-01-01

Applied Mathematics and Computation

Abstract:Understanding origin of cooperation denotes one of the most challenging conundrums across myriad disciplines. Different from previous assumption that all the individuals have identical dilemma, here we put forward a heterogeneous sub-population model on regular lattices and complex networks: players face different dilemmas and cooperation tendency inside and outside sub-population. In details, each agent will play different games with the opponents from his own sub-population or from a different sub-population. By means of numerous simulations, we find that sub-population is a useful way to resolve social dilemmas, which is universally effective for interaction topology. Interestingly, less sub-populations can guarantee the optimal environment of cooperation, the continuous increment of sub-population number in turn impedes the evolution of cooperation, which though seems better than the traditional scenario (namely, pure prisoner's dilemma or snowdrift game on network). Moreover, the fraction of cooperation also depends on the related scale of such sub-populations. From the viewpoint of microscopic dynamics, we further explore the transition probability of different strategies and the organization of cooperator clusters. Because this framework of heterogeneous sub-populations is close to realistic life, we hope that it can provide new insight to resolve the social dilemmas.
Evolutionary Dynamics Of Public Goods Games With Diverse Contributions In Finite Populations

Jing Wang,Bin Wu,Xiaojie Chen,Long Wang

DOI: https://doi.org/10.1103/PhysRevE.81.056103

IF: 2.707

2010-01-01

Physical Review E

Abstract:The public goods game is a powerful metaphor for exploring the maintenance of social cooperative behavior in a group of interactional selfish players. Here we study the emergence of cooperation in the public goods games with diverse contributions in finite populations. The theory of stochastic process is innovatively adopted to investigate the evolutionary dynamics of the public goods games involving a diversity of contributions. In the limit of rare mutations, the general stationary distribution of this stochastic process can be analytically approximated by means of diffusion theory. Moreover, we demonstrate that increasing the diversity of contributions greatly reduces the probability of finding the population in a homogeneous state full of defectors. This increase also raises the expectation of the total contribution in the entire population and thus promotes social cooperation. Furthermore, by investigating the evolutionary dynamics of optional public goods games with diverse contributions, we find that nonparticipation can assist players who contribute more in resisting invasion and taking over individuals who contribute less. In addition, numerical simulations are performed to confirm our analytical results. Our results may provide insight into the effect of diverse contributions on cooperative behaviors in the real world.
Cooperative Evolution Based on Social Capital:a Simulation Using Agent-based Modeling

HUANG Huang

DOI: https://doi.org/10.3969/j.issn.1002-9753.2010.09.019

2010-01-01

Abstract:How do humans maintain a high level of cooperation despite a low level of genetic relatedness,especially in large scale society? Experimental research suggests that social capital facilitate social cooperation.This article formalized social capital and offered a new model of cooperation evolution.Using agent-based modeling approach,we simulated the evolutionary process of interaction between social cooperation and social capital,which can explain the cooperation in large scale society formally.
Simulating the Evolution of Cooperation Based on Trust and Network

黄璜

DOI: https://doi.org/10.3969/j.issn.1001-8409.2010.02.007

2010-01-01

Soft Science

Abstract:This paper builds up a model of cooperation evolution through a new computational modeling paradigm named agent-based modeling and simulats it in four scenarios,including profit/cost ratio,social scale,cooperation scale and (resource distribution facilitate or impede cooperation emergence.
Social Dilemmas in an Online Social Network: the Structure and Evolution of Cooperation

Feng Fu,Xiaojie Chen,Lianghuan Liu,Long Wang

DOI: https://doi.org/10.1016/j.physleta.2007.05.116

IF: 2.707

2007-01-01

Physics Letters A

Abstract:We investigate two paradigms for studying the evolution of cooperation—Prisoner's Dilemma and Snowdrift game in an online friendship network, obtained from a social networking site. By structural analysis, it is revealed that the empirical social network has small-world and scale-free properties. Besides, it exhibits assortative mixing pattern. Then, we study the evolutionary version of the two types of games on it. It is found that cooperation is substantially promoted with small values of game matrix parameters in both games. Whereas the competent cooperators induced by the underlying network of contacts will be dramatically inhibited with increasing values of the game parameters. Further, we explore the role of assortativity in evolution of cooperation by random edge rewiring. We find that increasing amount of assortativity will to a certain extent diminish the cooperation level. We also show that connected large hubs are capable of maintaining cooperation. The evolution of cooperation on empirical networks is influenced by various network effects in a combined manner, compared with that on model networks. Our results can help understand the cooperative behaviors in human groups and society.
Cooperative Behavior in a Model of Evolutionary Snowdrift Games with N-person Interactions

D. F. Zheng,H. P. Yin,C. H. Chan,P. M. Hui

DOI: https://doi.org/10.1209/0295-5075/80/18002

2007-01-01

EPL (Europhysics Letters)

Abstract:We propose a model of evolutionary snowdrift game with N-person interactions and study the effects of multi-person interactions on the emergence of cooperation. An exact N-th–order equation for the equilibrium density of cooperators x* is derived for a well-mixed population using the approach of replicator dynamics. The results show that the extent of cooperation drops with increasing cost-to-benefit ratio and the number N of interaction persons in a group, with x*∼1/N for large N. An algorithm for numerical simulations is constructed for the model. The simulation results are in good agreement with theoretical results of the replicator dynamics.

Electronic supplementary material for "spatial reciprocity in the evolution of cooperation" from Spatial reciprocity in the evolution of cooperation

Cooperation and Charity in Spatial Public Goods Game under Different Strategy Update Rules

Spatial reciprocity in the evolution of cooperation.

Evolution of Cooperation in Spatio-Temporal Evolutionary Games with Public Goods Feedback

Spatial Structure Favors Cooperative Behavior in the Snowdrift Game with Multiple Interactive Dynamics

Evolution of cooperation with asymmetric social interactions

The Evolution of Cooperation in Spatial Groups

Numerical and Analytical Study of Evolution of Indirect Reciprocity

Emergence of Cooperation in Spatial Public Goods Game with Conditional Participation

Dynamical reciprocity in interacting games: Numerical results and mechanism analysis

Cooperation in evolutionary games incorporated with extended Q-learning algorithm

Agent-based evolutionary game dynamics uncover the dual role of resource heterogeneity in the evolution of cooperation

The evolution of cooperation in spatial prisoner’s dilemma games with heterogeneous relationships

Spatial alignment, group strategy and non-kin selection enable the evolution of cooperation

Effect of heterogeneous investments on the evolution of cooperation in spatial public goods game.

Effect of Heterogeneous Sub-Populations on the Evolution of Cooperation

Evolutionary Dynamics Of Public Goods Games With Diverse Contributions In Finite Populations

Cooperative Evolution Based on Social Capital:a Simulation Using Agent-based Modeling

Simulating the Evolution of Cooperation Based on Trust and Network

Social Dilemmas in an Online Social Network: the Structure and Evolution of Cooperation

Cooperative Behavior in a Model of Evolutionary Snowdrift Games with N-person Interactions