Abstract:Simulation models, in particular agent-based models, are gaining popularity in economics and the social sciences. The considerable flexibility they offer, as well as their capacity to reproduce a variety of empirically observed behaviors of complex systems, give them broad appeal, and the increasing availability of cheap computing power has made their use feasible. Yet a widespread adoption in real-world modelling and decision-making scenarios has been hindered by the difficulty of performing parameter estimation for such models. In general, simulation models lack a tractable likelihood function, which precludes a straightforward application of standard statistical inference techniques. A number of recent works have sought to address this problem through the application of likelihood-free inference techniques, in which parameter estimates are determined by performing some form of comparison between the observed data and simulation output. However, these approaches are (a) founded on restrictive assumptions, and/or (b) typically require many hundreds of thousands of simulations. These qualities make them unsuitable for large-scale simulations in economics and the social sciences, and can cast doubt on the validity of these inference methods in such scenarios. In this paper, we investigate the efficacy of two classes of simulation-efficient black-box approximate Bayesian inference methods that have recently drawn significant attention within the probabilistic machine learning community: neural posterior estimation and neural density ratio estimation. We present a number of benchmarking experiments in which we demonstrate that neural network-based black-box methods provide state of the art parameter inference for economic simulation models, and crucially are compatible with generic multivariate or even non-Euclidean time-series data. In addition, we suggest appropriate assessment criteria for use in future benchmarking of approximate Bayesian inference procedures for simulation models in economics and the social sciences.

Challenges and Opportunities for Twenty First Century Bayesian Econometricians: A Personal View

Bayesian Methods for Empirical Macroeconomics with Big Data

Bayesian Models and Methods in Public Policy and Government Settings

Black-box Bayesian inference for agent-based models

Bayesian analysis of extreme values in economic indexes and climate data: Simulation and application

Bayesian spatial econometrics: a software architecture

Advances in Bayesian network modelling: Integration of modelling technologies

A Full Bayesian Model to Handle Structural Ones and Missingness in Economic Evaluations from Individual-Level Data

A bright future for financial agent-based models

The Bayesian Synthetic Control: Improved Counterfactual Estimation in the Social Sciences through Probabilistic Modeling

Fully Bayesian Benchmarking of Small Area Estimation Models

Bayesian statistics in educational research: a look at the current state of affairs

A Novel Framework for Analyzing Structural Transformation in Data-Constrained Economies Using Bayesian Modeling and Machine Learning

Bayesian forecasting of multivariate time series: Scalability, structure uncertainty and decisions

On Using Bayesian Methods to Address Small Sample Problems

Studying economic complexity with agent-based models: advances, challenges and future perspectives

Bayesian Model-Based Approach: Impact on Science and Policy

Bayesian Computing in the Undergraduate Statistics Curriculum

A comprehensive review of Bayesian statistics in natural hazards engineering

Agent Based-Stock Flow Consistent Macroeconomics: Towards a Benchmark Model