Abstract:Generative agents, which implement behaviors using a large language model (LLM) to interpret and evaluate an environment, has demonstrated the capacity to solve complex tasks across many social and technological domains. However, when these agents interact with other agents and humans in presence of social structures such as existing norms, fostering cooperation between them is a fundamental challenge. In this paper, we develop the framework of a 'Normative Module': an architecture designed to enhance cooperation by enabling agents to recognize and adapt to the normative infrastructure of a given environment. We focus on the equilibrium selection aspect of the cooperation problem and inform our agent design based on the existence of classification institutions that implement correlated equilibrium to provide effective resolution of the equilibrium selection problem. Specifically, the normative module enables agents to learn through peer interactions which of multiple candidate institutions in the environment, does a group treat as authoritative. By enabling normative competence in this sense, agents gain ability to coordinate their sanctioning behaviour; coordinated sanctioning behaviour in turn shapes primary behaviour within a social environment, leading to higher average welfare. We design a new environment that supports institutions and evaluate the proposed framework based on two key criteria derived from agent interactions with peers and institutions: (i) the agent's ability to disregard non-authoritative institutions and (ii) the agent's ability to identify authoritative institutions among several options. We show that these capabilities allow the agent to achieve more stable cooperative outcomes compared to baseline agents without the normative module, paving the way for research in a new avenue of designing environments and agents that account for normative infrastructure.

Norms, Institutions, and Robots

Robby is Not a Robber (anymore): On the Use of Institutions for Learning Normative Behavior

That's Mine! Learning Ownership Relations and Norms for Robots

Norm Identification through Plan Recognition

Enabling Basic Normative HRI in a Cognitive Robotic Architecture

Extended norms: locating accountable decision-making in contexts of human-robot interaction

Normative Modules: A Generative Agent Architecture for Learning Norms that Supports Multi-Agent Cooperation

Practical Reasoning with Norms for Autonomous Software Agents (Full Edition)

Norm Enforcement with a Soft Touch: Faster Emergence, Happier Agents

Legible Normativity for AI Alignment: The Value of Silly Rules

Emergence of Social Norms in Generative Agent Societies: Principles and Architecture

Commitments in Human-Robot Interaction

Norm Conflict Resolution in Stochastic Domains

Social Rules for Agent Systems

SONAR: An Adaptive Control Architecture for Social Norm Aware Robots

Social Practices: a Complete Formalization

HANDLING NORMS IN MULTI-AGENT SYSTEM BY MEANS OF FORMAL ARGUMENTATION

NormBank: A Knowledge Bank of Situational Social Norms

Building Jiminy Cricket

What am I allowed to do here?: Online Learning of Context-Specific Norms by Pepper

Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences