Abstract:Generative agents, which implement behaviors using a large language model (LLM) to interpret and evaluate an environment, has demonstrated the capacity to solve complex tasks across many social and technological domains. However, when these agents interact with other agents and humans in presence of social structures such as existing norms, fostering cooperation between them is a fundamental challenge. In this paper, we develop the framework of a 'Normative Module': an architecture designed to enhance cooperation by enabling agents to recognize and adapt to the normative infrastructure of a given environment. We focus on the equilibrium selection aspect of the cooperation problem and inform our agent design based on the existence of classification institutions that implement correlated equilibrium to provide effective resolution of the equilibrium selection problem. Specifically, the normative module enables agents to learn through peer interactions which of multiple candidate institutions in the environment, does a group treat as authoritative. By enabling normative competence in this sense, agents gain ability to coordinate their sanctioning behaviour; coordinated sanctioning behaviour in turn shapes primary behaviour within a social environment, leading to higher average welfare. We design a new environment that supports institutions and evaluate the proposed framework based on two key criteria derived from agent interactions with peers and institutions: (i) the agent's ability to disregard non-authoritative institutions and (ii) the agent's ability to identify authoritative institutions among several options. We show that these capabilities allow the agent to achieve more stable cooperative outcomes compared to baseline agents without the normative module, paving the way for research in a new avenue of designing environments and agents that account for normative infrastructure.

A Social Norm for Multi-Agent System

The Social Construction Logic of Property Rights:A review on the property rights studies of Chinese sociologists from the perspective of game theory

Norm Enforcement with a Soft Touch: Faster Emergence, Happier Agents

Prosocial Norm Emergence in Multiagent Systems

Social Norms for Online Communities

Emergence of Social Norms in Generative Agent Societies: Principles and Architecture

Normative Agent Social

Normative Modules: A Generative Agent Architecture for Learning Norms that Supports Multi-Agent Cooperation

HANDLING NORMS IN MULTI-AGENT SYSTEM BY MEANS OF FORMAL ARGUMENTATION

Cooperative Problem Solving Process Based on MAS_NP Model

Social Norm Design for Information Exchange Systems with Limited Observations

Negotiating Socially Optimal Allocations of Resources

Social Rules for Agent Systems

Run-time Norms Synthesis in Multi-Objective Multi-Agent Systems

Evolution of collective fairness in complex networks through degree-based role assignment

A learning agent that acquires social norms from public sanctions in decentralized multi-agent settings

How norms shape the evolution of prosocial behavior. Compassion, Universalizability, Reciprocity, Equity: A C.U.R.E for social dilemmas

Mathematical frameworks for the analysis of norms

Social norms and cooperation in higher-order networks

How norms shape the evolution of prosocial behaviour–compassion, universalizability, reciprocity and equity: a C.U.R.E for social dilemmas

On the effect of social norms on performance in teams with distributed decision makers