Abstract:In an autonomous system, rational agents aim to maximize their benefits. Rational agents gradually give up cooperation with others and only request services, which leads to the phenomenon of free-riding. This phenomenon generally exists in the real society and application system. Therefore, how to reduce the behavior, which is similar to free-riding, has become an important research topic. In addition, the traditional pairwise interaction network cannot truly reflect the interaction properties of cooperative events. Social norms provide an effective way to promote cooperation for autonomous systems. Axelrod’s metanorm game model achieves the emergence of social norms by conducting punishment to connivance based on punishing defection. However, links in networks only allow for pairwise interactions. Therefore, we introduce hypergraphs, which are more suitable to reflect group interaction to model metanorm games. The establishment efforts of norms are examined on hypergraphs (uniform random hypergraph (URH), hyperdegree-heterogeneous random hypergraphs, and real-world hypergraphs). We show that the difference in group sizes affects norms emergence of agents and realize the establishment of social norms on URH. To a certain extent, the probability of being seen is positively correlated with agents’ vengefulness and learning time and negatively correlated with boldness. However, the usage of the boldness and vengefulness learning (BV-learning) algorithm on HRHs cannot make norms emergence because leavers cannot participate in learning and the fixed learning step. Therefore, we propose the dynamic relevance BV-learning algorithm to overcome the aforementioned problems, so hub agents and leavers can jointly establish better social norms. We also verify the evolution process of agents’ cooperation rate by BV-learning and the dynamic relevance BV-learning, respectively, which demonstrate that the establishment of social norms can indeed promote agents’ cooperation. Finally, in order to illustrate the universality of the dynamic relevance BV-learning clearly, we study norms establishment on real-world hypergraphs by and compare it with BV-learning. It can be found that the dynamic relevance BV-learning can effectively establish social norms on real-world hypergraphs.

Efficient and Robust Emergence of Norms Through Heuristic Collective Learning

Heuristic Collective Learning for Efficient and Robust Emergence of Social Norms

Emergence of Social Norms Through Collective Learning in Networked Agent Societies.

Collective learning for the emergence of social norms in networked multiagent systems

Collective Learning and Information Diffusion for Efficient Emergence of Social Norms

Hierarchical Heuristic Learning towards Effcient Norm Emergence

Learning Intra-group Cooperation in Multi-agent Systems.

Neural Learning for the Emergence of Social Norms in Multiagent Systems

Emergence of Social Norms in Metanorms Game with High-Order Interaction Topology.

Norm Enforcement with a Soft Touch: Faster Emergence, Happier Agents

A learning agent that acquires social norms from public sanctions in decentralized multi-agent settings

Prosocial Norm Emergence in Multiagent Systems

The Dynamics of Reinforcement Social Learning in Networked Cooperative Multiagent Systems

Learning and Sustaining Shared Normative Systems via Bayesian Rule Induction in Markov Games

Social norms and cooperation in higher-order networks

Enhancing Cooperation through Selective Interaction and Long-term Experiences in Multi-Agent Reinforcement Learning

Collective Emergence in A Multi-Agent Network with Adaptive Games

Adaptive Network Intervention for Complex Systems: A Hierarchical Graph Reinforcement Learning Approach

Evolving Neural Networks Reveal Emergent Collective Behavior from Minimal Agent Interactions

Modelling Adaptive Learning Behaviours for Consensus Formation in Human Societies

Dynamics of Moral Behavior in Heterogeneous Populations of Learning Agents