The toughness, elasticity, color, and consistency of cooperation

Petter Holme

DOI: https://doi.org/10.1016/j.plrev.2023.05.011

2023-05-28

Abstract:This is a comment on a recent review article about reputation and reciprocity as mechanisms promoting cooperation. I also discuss the necessary changes for the currently game-theory-based cooperation studies to become a complete theory of cooperation in our contemporary society.

Physics and Society

What problem does this paper attempt to address?

Reputation and reciprocity

Chengyi Xia,Juan Wang,Matjaž Perc,Zhen Wang

DOI: https://doi.org/10.1016/j.plrev.2023.05.002

Abstract:Reputation and reciprocity are key mechanisms for cooperation in human societies, often going hand in hand to favor prosocial behavior over selfish actions. Here we review recent researches at the interface of physics and evolutionary game theory that explored these two mechanisms. We focus on image scoring as the bearer of reputation, as well as on various types of reciprocity, including direct, indirect, and network reciprocity. We review different definitions of reputation and reciprocity dynamics, and we show how these affect the evolution of cooperation in social dilemmas. We consider first-order, second-order, as well as higher-order models in well-mixed and structured populations, and we review experimental works that support and inform the results of mathematical modeling and simulations. We also provide a synthesis of the reviewed researches along with an outlook in terms of six directions that seem particularly promising to explore in the future.
Review on Model of Cooperation Evolution

Huang HUANG

DOI: https://doi.org/10.13209/j.0479-8023.2011.026

2011-01-01

Abstract:This article reviews current research on cooperation evolutionary model.Based on Prisoner's Dilemma Game model,cooperation evolutionary model,offering individuals mechanisms of strategy optimizing unrelated with themselves,focuses on how cooperation can emerge from society.Evolutionary model based on theory of direct or indirect reciprocity proves reputation facilitate reciprocity cooperation in small scale society;reciprocity can be regarded as rewards to those cooperators that will dominate in society with open social network;punishment to those non-cooperators is good to n-person cooperation and a more stable equilibrium will emerge when non-cooperators are punishers under some conditions,comparing to when cooperators are;group competition facilitates the spread of cooperation culture or institution,but cannot explain cooperation when these groups merge.
Strong reciprocity : norms and preferences governing cooperation and punishment behaviour

Till O. Weber

2018-07-18

Abstract:Many problems that societies face have the character of social dilemmas, in which cooperation benefits the whole society but is costly to the individual. The recent literature in experimental economics has focused on uncovering driving factors of cooperative success in social dilemmas. This thesis contributes to this literature and includes three research studies that investigate the influence of individual cooperative dispositions, societal and cultural differences, as well as institutional differences on human cooperative behaviour. Chapter 1 introduces the research questions, discusses the research methods used, and outlines the substantive contributions of the thesis. Chapter 2 presents an experimental test of a common implicit assumption in the literature, which suggests that only people with a cooperative disposition engage in the punishment of defectors in social dilemmas. The experimental test rejects this assumption and shows that individual cooperativeness is independent of one's propensity to punish. Chapter 3 investigates the channels through which culture and societal differences affect cooperative behaviour. The experimental results show that societal differences in behaviour are mainly driven through differences in beliefs about other people's behaviour. Chapter 4 reports on an experimental comparison of informal and formal sanctioning institutions. These experiments show that informal sanctions like peer pressure are necessary to foster high and stable cooperation levels in the long run. Chapter 5 concludes.

Sociology,Psychology,Economics
Cooperation and Competition as Partners

Evert Van de Vliert

DOI: https://doi.org/10.1080/14792779943000071

IF: 5.652

1999-01-01

European Review of Social Psychology

Abstract:This review addresses the manifestations and consequences of interpersonal cooperation and competition in interdependent, organizational settings. It challenges the applicability of Deutsch's (1949, 1973) game-based cooperation–competition theory. Rather than separate motives and separate behaviours having separate effects, cooperation and competition seem to refer to entwined motives and behaviours moderating each other's impact on dyadic or group effectiveness. The field of cooperation–competition in organizations is in need of a shift of perspective, as well as a revised research agenda including nation-referenced studies. Nation-referenced research places its results in the context of a country's cooperative and competitive cultural values and practices, with mean atmospheric temperature as a rough indicator of the degrees of cooperation and competition to be expected.

psychology, social
Harnessing the power of reputation: strengths and limits for promoting cooperative behaviors

Pat Barclay

DOI: https://doi.org/10.1177/147470491201000509

2012-12-20

Abstract:Evolutionary approaches have done much to identify the pressures that select for cooperative sentiment. This helps us understand when and why cooperation will arise, and applied research shows how these pressures can be harnessed to promote various types of cooperation. In particular, recent evidence shows how opportunities to acquire a good reputation can promote cooperation in laboratory and applied settings. Cooperation can be promoted by tapping into forces like indirect reciprocity, costly signaling, and competitive altruism. When individuals help others, they receive reputational benefits (or avoid reputational costs), and this gives people an incentive to help. Such findings can be applied to promote many kinds of helping and cooperation, including charitable donations, tax compliance, sustainable and pro-environmental behaviors, risky heroism, and more. Despite the potential advantages of using reputation to promote positive behaviors, there are several risks and limits. Under some circumstances, opportunities for reputation will be ineffective or promote harmful behaviors. By better understanding the dynamics of reputation and the circumstances under which cooperation can evolve, we can better design social systems to increase the rate of cooperation and reduce conflict.
Tit for Tattling: Cooperation, communication, and how each could stabilize the other

Victor Vikram Odouard,Michael Holton Price

2023-08-05

Abstract:Indirect reciprocity is a mechanism by which individuals cooperate with those who have cooperated with others. This creates a regime in which repeated interactions are not necessary to incent cooperation (as would be required for direct reciprocity). However, indirect reciprocity creates a new problem: how do agents know who has cooperated with others? To know this, agents would need to access some form of reputation information. Perhaps there is a communication system to disseminate reputation information, but how does it remain truthful and informative? Most papers assume the existence of a truthful, forthcoming, and informative communication system; in this paper, we seek to explain how such a communication system could remain evolutionarily stable in the absence of exogenous pressures. Specifically, we present three conditions that together maintain both the truthfulness of the communication system and the prevalence of cooperation: individuals (1) use a norm that rewards the behaviors that it prescribes (an aligned norm), (2) can signal not only about the actions of other agents, but also about their truthfulness (by acting as third party observers to an interaction), and (3) make occasional mistakes, demonstrating how error can create stability by introducing diversity.

Populations and Evolution,Theoretical Economics
Networks of reliable reputations and cooperation: a review

Károly Takács,Jörg Gross,Martina Testori,Srebrenka Letina,Adam R Kenny,Eleanor A Power,Rafael P M Wittek

DOI: https://doi.org/10.1098/rstb.2020.0297

2021-11-22

Abstract:Reputation has been shown to provide an informal solution to the problem of cooperation in human societies. After reviewing models that connect reputations and cooperation, we address how reputation results from information exchange embedded in a social network that changes endogenously itself. Theoretical studies highlight that network topologies have different effects on the extent of cooperation, since they can foster or hinder the flow of reputational information. Subsequently, we review models and empirical studies that intend to grasp the coevolution of reputations, cooperation and social networks. We identify open questions in the literature concerning how networks affect the accuracy of reputations, the honesty of shared information and the spread of reputational information. Certain network topologies may facilitate biased beliefs and intergroup competition or in-group identity formation that could lead to high cooperation within but conflicts between different subgroups of a network. Our review covers theoretical, experimental and field studies across various disciplines that target these questions and could explain how the dynamics of interactions and reputations help or prevent the establishment and sustainability of cooperation in small- and large-scale societies. This article is part of the theme issue 'The language of cooperation: reputation and honest signalling'.
Indirect reciprocity with stochastic rules

Yohsuke Murase,Christian Hilbe

DOI: https://doi.org/10.1371/journal.pcbi.1011271

2023-03-02

Abstract:Cooperation is a crucial aspect of social life, yet understanding the nature of cooperation and how it can be promoted is an ongoing challenge. One mechanism for cooperation is indirect reciprocity. According to this mechanism, individuals cooperate to maintain a good reputation. This idea is embodied in a set of social norms called the ``leading eight''. When all information is publicly available, these norms have two major properties. Populations that employ these norms are fully cooperative, and they are stable against invasion by alternative norms. In this paper, we extend the framework of the leading eight in two directions. First, we allow social norms to be stochastic. Such norms allow individuals to evaluate others with certain probabilities. Second, we consider norms in which also the reputations of passive recipients can be updated. Using this framework, we characterize all evolutionarily stable norms that lead to full cooperation in the public information regime. When only the donor's reputation is updated, and all updates are deterministic, we recover the conventional model. In that case, we find two classes of stable norms: the leading eight and the `secondary sixteen'. Stochasticity can further help to stabilize cooperation when the benefit of cooperation is comparably small. Moreover, updating the recipients' reputations can help populations to recover more quickly from errors. Overall, our study highlights a remarkable trade-off between the evolutionary stability of a norm and its robustness with respect to errors. Norms that correct errors quickly require higher benefits of cooperation to be stable.

Populations and Evolution,Physics and Society
Comments on evolution of cooperation: assortative encounters with selfknowledge

Pawel Sobkowicz

DOI: https://doi.org/10.48550/arXiv.cond-mat/0310208

2003-10-09

Disordered Systems and Neural Networks

Abstract:The theoretical description of the evolution of cooperation presented by Bergstrom based on assortative matching with partner choice allows to model the population dynamics in a game of Nonrepetitive Prisoners Dilemma. In this paper we present a short analysis of asymmetric effects brought into the game by self knowledge of the participants, that is the knowledge of one's own strategy. Within the same conceptual framework as introduced by Bergstrom inclusion of selfknowledge leads to different behaviour of the assortativity index and changes in payoffs for different strategies.
Indirect reciprocity under opinion synchronization

Yohsuke Murase,Christian Hilbe

2024-10-15

Abstract:Indirect reciprocity is a key explanation for the exceptional magnitude of cooperation among humans. This literature suggests that a large proportion of human cooperation is driven by social norms and individuals' incentives to maintain a good reputation. This intuition has been formalized with two types of models. In public assessment models, all community members are assumed to agree on each others' reputations; in private assessment models, people may have disagreements. Both types of models aim to understand the interplay of social norms and cooperation. Yet their results can be vastly different. Public assessment models argue that cooperation can evolve easily, and that the most effective norms tend to be stern. Private assessment models often find cooperation to be unstable, and successful norms show some leniency. Here, we propose a model that can organize these differing results within a single framework. We show that the stability of cooperation depends on a single quantity: the extent to which individual opinions turn out to be correlated. This correlation is determined by a group's norms and the structure of social interactions. In particular, we prove that no cooperative norm is evolutionarily stable when individual opinions are statistically independent. These results have important implications for our understanding of cooperation, conformity, and polarization.

Physics and Society,Populations and Evolution
Cooperation and social organization depend on weighing private and public reputations

Matteo Cavaliere,Guoli Yang,Carsten K W De Dreu,Jörg Gross

DOI: https://doi.org/10.1038/s41598-024-67080-z

2024-07-16

Abstract:To avoid exploitation by defectors, people can use past experiences with others when deciding to cooperate or not ('private information'). Alternatively, people can derive others' reputation from 'public' information provided by individuals within the social network. However, public information may be aligned or misaligned with one's own private experiences and different individuals, such as 'friends' and 'enemies', may have different opinions about the reputation of others. Using evolutionary agent-based simulations, we examine how cooperation and social organization is shaped when agents (1) prioritize private or public information about others' reputation, and (2) integrate others' opinions using a friend-focused or a friend-and-enemy focused heuristic (relying on reputation information from only friends or also enemies, respectively). When agents prioritize public information and rely on friend-and-enemy heuristics, we observe polarization cycles marked by high cooperation, invasion by defectors, and subsequent population fragmentation. Prioritizing private information diminishes polarization and defector invasions, but also results in limited cooperation. Only when using friend-focused heuristics and following past experiences or the recommendation of friends create prosperous and stable populations based on cooperation. These results show how combining one's own experiences and the opinions of friends can lead to stable and large-scale cooperation and highlight the important role of following the advice of friends in the evolution of group cooperation.
The Evolution of Reputation-Based Cooperation in Regular Networks

Tatsuya Sasaki,Hitoshi Yamamoto,Isamu Okada,Satoshi Uchida

DOI: https://doi.org/10.48550/arXiv.1701.06153

2017-01-22

Physics and Society

Abstract:Despite recent advances in reputation technologies, it is not clear how reputation systems can affect human cooperation in social networks. Although it is known that two of the major mechanisms in the evolution of cooperation are spatial selection and reputation-based reciprocity, theoretical study of the interplay between both mechanisms remains almost uncharted. Here, we present a new individual-based model for the evolution of reciprocal cooperation between reputation and networks. We comparatively analyze four of the leading moral assessment rules---shunning, image scoring, stern judging, and simple standing---and base the model on the giving game in regular networks for Cooperators, Defectors, and Discriminators. Discriminators rely on a proper moral assessment rule. By using individual-based models, we show that the four assessment rules are differently characterized in terms of how cooperation evolves, depending on the benefit-to-cost ratio, the network-node degree, and the observation and error conditions. Our findings show that the most tolerant rule---simple standing---is the most robust among the four assessment rules in promoting cooperation in regular networks.
Evolution of cooperation in stochastic games

Christian Hilbe,Štěpán Šimsa,Krishnendu Chatterjee,Martin A. Nowak

DOI: https://doi.org/10.1038/s41586-018-0277-x

IF: 64.8

2018-07-01

Nature

Abstract:Social dilemmas occur when incentives for individuals are misaligned with group interests1–7. According to the ‘tragedy of the commons’, these misalignments can lead to overexploitation and collapse of public resources. The resulting behaviours can be analysed with the tools of game theory8. The theory of direct reciprocity9–15 suggests that repeated interactions can alleviate such dilemmas, but previous work has assumed that the public resource remains constant over time. Here we introduce the idea that the public resource is instead changeable and depends on the strategic choices of individuals. An intuitive scenario is that cooperation increases the public resource, whereas defection decreases it. Thus, cooperation allows the possibility of playing a more valuable game with higher payoffs, whereas defection leads to a less valuable game. We analyse this idea using the theory of stochastic games16–19 and evolutionary game theory. We find that the dependence of the public resource on previous interactions can greatly enhance the propensity for cooperation. For these results, the interaction between reciprocity and payoff feedback is crucial: neither repeated interactions in a constant environment nor single interactions in a changing environment yield similar cooperation rates. Our framework shows which feedbacks between exploitation and environment—either naturally occurring or designed—help to overcome social dilemmas.

multidisciplinary sciences
Cooperation and Reputation Dynamics with Reinforcement Learning

Nicolas Anastassacos,Julian García,Stephen Hailes,Mirco Musolesi

DOI: https://doi.org/10.48550/arXiv.2102.07523

2021-02-15

Abstract:Creating incentives for cooperation is a challenge in natural and artificial systems. One potential answer is reputation, whereby agents trade the immediate cost of cooperation for the future benefits of having a good reputation. Game theoretical models have shown that specific social norms can make cooperation stable, but how agents can independently learn to establish effective reputation mechanisms on their own is less understood. We use a simple model of reinforcement learning to show that reputation mechanisms generate two coordination problems: agents need to learn how to coordinate on the meaning of existing reputations and collectively agree on a social norm to assign reputations to others based on their behavior. These coordination problems exhibit multiple equilibria, some of which effectively establish cooperation. When we train agents with a standard Q-learning algorithm in an environment with the presence of reputation mechanisms, convergence to undesirable equilibria is widespread. We propose two mechanisms to alleviate this: (i) seeding a proportion of the system with fixed agents that steer others towards good equilibria; and (ii), intrinsic rewards based on the idea of introspection, i.e., augmenting agents' rewards by an amount proportionate to the performance of their own strategy against themselves. A combination of these simple mechanisms is successful in stabilizing cooperation, even in a fully decentralized version of the problem where agents learn to use and assign reputations simultaneously. We show how our results relate to the literature in Evolutionary Game Theory, and discuss implications for artificial, human and hybrid systems, where reputations can be used as a way to establish trust and cooperation.

Multiagent Systems,Artificial Intelligence
The language of cooperation: reputation and honest signalling

S. Számadó,D. Balliet,F. Giardini,E. A. Power,K. Takács

DOI: https://doi.org/10.1098/rstb.2020.0286

2021-10-04

Abstract:Large-scale non-kin cooperation is a unique ingredient of human success. This type of cooperation is challenging to explain in a world of self-interested individuals. There is overwhelming empirical evidence from different disciplines that reputation and gossip promote cooperation in humans in different contexts. Despite decades of research, important details of reputation systems are still unclear. Our goal with this theme issue is to promote an interdisciplinary approach that allows us to explore and understand the evolution and maintenance of reputation systems with a special emphasis on gossip and honest signalling. The theme issue is organized around four main questions: What are the necessary conditions for reputation-based systems? What is the content and context of reputation systems? How can reputations promote cooperation? And, what is the role of gossip in maintaining reputation systems and thus cooperation? This article is part of the theme issue ‘The language of cooperation: reputation and honest signalling’.
Coevolutionary games—A mini review

Matjaž Perc,Attila Szolnoki

DOI: https://doi.org/10.1016/j.biosystems.2009.10.003

IF: 1.957

2010-02-01

Biosystems

Abstract:Prevalence of cooperation within groups of selfish individuals is puzzling in that it contradicts with the basic premise of natural selection. Favoring players with higher fitness, the latter is key for understanding the challenges faced by cooperators when competing with defectors. Evolutionary game theory provides a competent theoretical framework for addressing the subtleties of cooperation in such situations, which are known as social dilemmas. Recent advances point towards the fact that the evolution of strategies alone may be insufficient to fully exploit the benefits offered by cooperative behavior. Indeed, while spatial structure and heterogeneity, for example, have been recognized as potent promoters of cooperation, coevolutionary rules can extend the potentials of such entities further, and even more importantly, lead to the understanding of their emergence. The introduction of coevolutionary rules to evolutionary games implies, that besides the evolution of strategies, another property may simultaneously be subject to evolution as well. Coevolutionary rules may affect the interaction network, the reproduction capability of players, their reputation, mobility or age. Here we review recent works on evolutionary games incorporating coevolutionary rules, as well as give a didactic description of potential pitfalls and misconceptions associated with the subject. In addition, we briefly outline directions for future research that we feel are promising, thereby particularly focusing on dynamical effects of coevolutionary rules on the evolution of cooperation, which are still widely open to research and thus hold promise of exciting new discoveries.

biology,mathematical & computational biology
Correlation of Positive and Negative Reciprocity Fails to Confer an Evolutionary Advantage: Phase Transitions to Elementary Strategies

Attila Szolnoki,Matjaž Perc

DOI: https://doi.org/10.1103/physrevx.3.041021

2013-11-27

Physical Review X

Abstract:Economic experiments reveal that humans value cooperation and fairness. Punishing unfair behavior is therefore common, and according to the theory of strong reciprocity, it is also directly related to rewarding cooperative behavior. However, empirical data fail to confirm that positive and negative reciprocity are correlated. Inspired by this disagreement, we determine whether the combined application of reward and punishment is evolutionarily advantageous. We study a spatial public goods game, where in addition to the three elementary strategies of defection, rewarding, and punishment, a fourth strategy that combines the latter two competes for space. We find rich dynamical behavior that gives rise to intricate phase diagrams where continuous and discontinuous phase transitions occur in succession. Indirect territorial competition, spontaneous emergence of cyclic dominance, as well as divergent fluctuations of oscillations that terminate in an absorbing phase are observed. Yet, despite the high complexity of solutions, the combined strategy can survive only in very narrow and unrealistic parameter regions. Elementary strategies, either in pure or mixed phases, are much more common and likely to prevail. Our results highlight the importance of patterns and structure in human cooperation, which should be considered in future experiments.

physics, multidisciplinary
The evolution of cooperation

Robert M. May

DOI: https://doi.org/10.2307/2392957

IF: 56.9

1981-07-23

Science

Abstract:Cooperation in organisms, whether bacteria or primates, has been a difficulty for evolutionary theory since Darwin. On the assumption that interactions between pairs of individuals occur on a probabilistic basis, a model is developed based on the concept of an evolutionarily stable strategy in the context of the Prisoner's Dilemma game. Deductions from the model, and the results of a computer tournament show how cooperation based on reciprocity can get started in an asocial world, can thrive while interacting with a wide range of other strategies, and can resist invasion once fully established. Potential applications include specific aspects of territoriality, mating, and disease.

Computer Science,Mathematics,Biology,Medicine,Sociology,Economics
Simple Records Support Robust Indirect Reciprocity

Daniel Clark,Drew Fudenberg,Alexander Wolitzky

DOI: https://doi.org/10.48550/arXiv.1910.03918

2019-10-09

Abstract:Indirect reciprocity is a foundational mechanism of human cooperation. Existing models of indirect reciprocity fail to robustly support social cooperation: image scoring models fail to provide robust incentives, while social standing models are not informationally robust. Here we provide a new model of indirect reciprocity based on simple, decentralized records: each individual's record depends on their own past behavior alone, and not on their partners' past behavior or their partners' partners' past behavior. When social dilemmas exhibit a coordination motive (or strategic complementarity), tolerant trigger strategies based on simple records can robustly support positive social cooperation and exhibit strong stability properties. In the opposite case of strategic substitutability, positive social cooperation cannot be robustly supported. Thus, the strength of short-run coordination motives in social dilemmas determines the prospects for robust long-run cooperation.

Populations and Evolution
Tacit Cooperation

Ze-hui GE,Qi-ying HU

DOI: https://doi.org/10.3321/j.issn:1000-6788.2007.07.006

2007-01-01

Abstract:Besides formal cooperation which depends on ex ante communications, firms can cooperate unformally through tacit understanding and agreement on social norms, culture, values, and beliefs etc. Tacit cooperation have four signicaficant characters: fuzzy behavior patterns, high dependence on subjects, duality, and decision decentralization. This paper shows that cooperative incentives come from not only reciprocal subordination (or the avoidance of reciprocal retaliation), but also the concern about the totalprofits. Therefore, a virtual player whose utility is the total profits is introduced. Furthermore, the contributive preferences to collaboration and the η-balanced strategic bundle are defined. By studying on the structure of the set of the contributive preferences to collaboration, we show that the set of firms' contributive preferences to collaboration is convex. Under some conditions, all of the optimal contributive preferences to collaboration must be in the same isometric super-surface of a convex function.

The toughness, elasticity, color, and consistency of cooperation

Reputation and reciprocity

Review on Model of Cooperation Evolution

Strong reciprocity : norms and preferences governing cooperation and punishment behaviour

Cooperation and Competition as Partners

Harnessing the power of reputation: strengths and limits for promoting cooperative behaviors

Tit for Tattling: Cooperation, communication, and how each could stabilize the other

Networks of reliable reputations and cooperation: a review

Indirect reciprocity with stochastic rules

Comments on evolution of cooperation: assortative encounters with selfknowledge

Indirect reciprocity under opinion synchronization

Cooperation and social organization depend on weighing private and public reputations

The Evolution of Reputation-Based Cooperation in Regular Networks

Evolution of cooperation in stochastic games

Cooperation and Reputation Dynamics with Reinforcement Learning

The language of cooperation: reputation and honest signalling

Coevolutionary games—A mini review

Correlation of Positive and Negative Reciprocity Fails to Confer an Evolutionary Advantage: Phase Transitions to Elementary Strategies

The evolution of cooperation

Simple Records Support Robust Indirect Reciprocity

Tacit Cooperation