Abstract:Agent-based models (ABMs) are simulation models used in economics to overcome some of the limitations of traditional frameworks based on general equilibrium assumptions. However, agents within an ABM follow predetermined 'bounded rational' behavioural rules which can be cumbersome to design and difficult to justify. Here we leverage multi-agent reinforcement learning (RL) to expand the capabilities of ABMs with the introduction of 'fully rational' agents that learn their policy by interacting with the environment and maximising a reward function. Specifically, we propose a 'Rational macro ABM' (R-MABM) framework by extending a paradigmatic macro ABM from the economic literature. We show that gradually substituting ABM firms in the model with RL agents, trained to maximise profits, allows for studying the impact of rationality on the economy. We find that RL agents spontaneously learn three distinct strategies for maximising profits, with the optimal strategy depending on the level of market competition and rationality. We also find that RL agents with independent policies, and without the ability to communicate with each other, spontaneously learn to segregate into different strategic groups, thus increasing market power and overall profits. Finally, we find that a higher number of rational (RL) agents in the economy always improves the macroeconomic environment as measured by total output. Depending on the specific rational policy, this can come at the cost of higher instability. Our R-MABM framework allows for stable multi-agent learning, is available in open source, and represents a principled and robust direction to extend economic simulators.

DEPLOYERS: An agent based modeling tool for multi country real world data

An agent-based modeling approach for real-world economic systems: Example and calibration with a Social Accounting Matrix of Spain

ABIDES-Economist: Agent-Based Simulation of Economic Systems with Learning Agents

EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activities

The Economics of the DeLend Project: Agent-based Simulations

Forecasting Macroeconomic Dynamics using a Calibrated Data-Driven Agent-based Model

Automated and Distributed Statistical Analysis of Economic Agent-Based Models

Scalable Agent-Based Modeling for Complex Financial Market Simulations

ABIDES: Towards High-Fidelity Market Simulation for AI Research

Data-Driven Economic Agent-Based Models

Agent Based-Stock Flow Consistent Macroeconomics: Towards a Benchmark Model

A Dynamic Agent Based Model of the Real Economy with Monopolistic Competition, Perfect Product Differentiation, Heterogeneous Agents, Increasing Returns to Scale and Trade in Disequilibrium

Debt, Investment, and Growth in Developing Countries with Segmented Labor Markets

Macroprudential Policy in a Heterogeneous Environment-An Application of Agent-Based Approach in Systemic Risk Modelling

A Multi-Agent Simulation of Retail Management Practices

Simulating the Economic Impact of Rationality through Reinforcement Learning and Agent-Based Modelling

Theories and Practice of Agent based Modeling: Some practical Implications for Economic Planners

Sabrina: Modeling and Visualization of Economy Data with Incremental Domain Knowledge

Economic evaluations with agent-based modelling: an introduction

A Novel Framework for Analyzing Structural Transformation in Data-Constrained Economies Using Bayesian Modeling and Machine Learning

Architecture for Modular Microsimulation of Real Estate Markets and Transportation