Abstract:It has been shown that social institutions impact human motivations to produce different behaviours, such as amount of working or specialisation in labor. With advancement in artificial intelligence (AI), specifically large language models (LLMs), now it is possible to perform in-silico simulations to test various hypotheses around this topic. Here, I simulate two somewhat similar worlds using multi-agent reinforcement learning (MARL) framework of the AI-Economist and generative agent-based model (GABM) framework of the Concordia. In the extended versions of the AI-Economist and Concordia, the agents are able to build houses, trade houses, and trade house building skill. Moreover, along the individualistic-collectivists axis, there are a set of three governing systems: Full-Libertarian, Semi-Libertarian/Utilitarian, and Full-Utilitarian. Additionally, in the extended AI-Economist, the Semi-Libertarian/Utilitarian system is further divided to a set of three governing institutions along the discriminative axis: Inclusive, Arbitrary, and Extractive. Building on these, I am able to show that among governing systems and institutions of the extended AI-Economist, under the Semi-Libertarian/Utilitarian and Inclusive government, the ratios of building houses to trading houses and trading house building skill are higher than the rest. Furthermore, I am able to show that in the extended Concordia when the central government care about equality in the society, the Full-Utilitarian system generates agents building more houses and trading more house building skill. In contrast, these economic activities are higher under the Full-Libertarian system when the central government cares about productivity in the society. Overall, the focus of this paper is to compare and contrast two advanced techniques of AI, MARL and GABM, to simulate a similar social phenomena with limitations.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: Under different governance systems or institutions, what are the differences in the behavioral motivations of agents in society in terms of building houses, trading houses, and trading house - building skills. Specifically, the author explores how these governance systems or institutions affect the behavior of agents by simulating two similar worlds, one based on the Multi - Agent Reinforcement Learning (MARL) framework and the other based on the Generative Agent - Based Model (GABM) framework. ### Research Background 1. **The Influence of Social Institutions on Human Behavior** - Social institutions (such as government systems) can motivate people to work more or less in society, focus on a specific area, or diversify their sources of income. - Traditional research methods usually rely on economists to construct mathematical models or conduct field experiments, but now with the help of artificial intelligence (AI), various hypotheses can be tested in a computer - simulated environment. 2. **Research Methods** - Use the Multi - Agent Reinforcement Learning (MARL) framework (AI - Economist) and the Generative Agent - Based Model (GABM) framework (Concordia) to simulate two similar social environments. - In these two frameworks, agents can build houses, trade houses, and trade house - building skills, and can rank the resources in the environment through a voting mechanism. 3. **Research Questions** - **Main Question**: Under different governance systems or institutions, what are the differences in the behavioral motivations of agents in terms of building houses, trading houses, and trading house - building skills? - **Specific Question**: On the individualism - collectivism axis and the discrimination axis, which governance systems or institutions can motivate agents to build more houses rather than trade houses or trade house - building skills? ### Simulation Settings 1. **Classification of Governance Systems** - **Individualism - Collectivism Axis** - Full - Libertarian - Semi - Libertarian/Utilitarian - Full - Utilitarian - **Discrimination Axis** (Only further divided in the Semi - Libertarian/Utilitarian system) - Inclusive - Arbitrary - Extractive 2. **Experimental Results** - In the MARL experiment, it was found that the proportion of agents in the Semi - Libertarian/Utilitarian governance system in building houses, trading houses, and trading house - building skills is the highest, especially in the Inclusive institution. - In the GABM experiment, when the game administrator focuses on social equality, the agents in the Full - Utilitarian governance system build more houses and trade more house - building skills; when focusing on productivity, the agents in the Full - Libertarian governance system build more houses, trade more houses, and trade more house - building skills at the same time. ### Conclusion This paper explores the influence of different governance systems or institutions on agent behavior by comparing two AI technologies, MARL and GABM. Although the results of the two methods are not exactly the same, they both show that agents can understand the simulated world to a certain extent and make long - term plans according to their inferred world models. ### Formula Representation To ensure the correctness and readability of the formulas, the following are some key formulas involved in the paper: - **Payment Multiple Distribution** \[ \text{Expert agents: } P_{\text{expert}} \sim \mathcal{N}(\mu_1, \sigma_1^2) \] \[ \text{Novice agents: } P_{\text{novice}} \sim \mathcal{N}(\mu_2, \sigma_2^2) \quad (\mu_1 > \mu_

Incentives to Build Houses, Trade Houses, or Trade House Building Skills in Simulated Worlds under Various Governing Systems or Institutions: Comparing Multi-agent Reinforcement Learning to Generative Agent-based Model

A Multi-agent Reinforcement Learning Study of Evolution of Communication and Teaching under Libertarian and Utilitarian Governing Systems

Formal Contracts Mitigate Social Dilemmas in Multi-Agent RL

Emergent Bartering Behaviour in Multi-Agent Reinforcement Learning

Formal contracts mitigate social dilemmas in multi-agent reinforcement learning

A Multi-agent Reinforcement Learning Study of Emergence of Social Classes out of Arbitrary Governance: The Role of Environment

Can AI with High Reasoning Ability Replicate Human-like Decision Making in Economic Experiments?

Simulating Human Strategic Behavior: Comparing Single and Multi-agent LLMs

Learning and Calibrating Heterogeneous Bounded Rational Market Behaviour with Multi-Agent Reinforcement Learning

Modeling Moral Choices in Social Dilemmas with Multi-Agent Reinforcement Learning

TaxAI: A Dynamic Economic Simulator and Benchmark for Multi-Agent Reinforcement Learning

Large Legislative Models: Towards Efficient AI Policymaking in Economic Simulations

Empirical Equilibria in Agent-based Economic systems with Learning agents

Simulating the Economic Impact of Rationality through Reinforcement Learning and Agent-Based Modelling

Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents

Computational Social Science: Agent-based social simulation

Adaptive Incentive Design with Multi-Agent Meta-Gradient Reinforcement Learning

Generative AI as Economic Agents

The AI Economist: Taxation policy design via two-level deep multiagent reinforcement learning

The Problem of Social Cost in Multi-Agent General Reinforcement Learning: Survey and Synthesis

The AI Economist: Optimal Economic Policy Design via Two-level Deep Reinforcement Learning