Abstract:Simulation models, in particular agent-based models, are gaining popularity in economics and the social sciences. The considerable flexibility they offer, as well as their capacity to reproduce a variety of empirically observed behaviors of complex systems, give them broad appeal, and the increasing availability of cheap computing power has made their use feasible. Yet a widespread adoption in real-world modelling and decision-making scenarios has been hindered by the difficulty of performing parameter estimation for such models. In general, simulation models lack a tractable likelihood function, which precludes a straightforward application of standard statistical inference techniques. A number of recent works have sought to address this problem through the application of likelihood-free inference techniques, in which parameter estimates are determined by performing some form of comparison between the observed data and simulation output. However, these approaches are (a) founded on restrictive assumptions, and/or (b) typically require many hundreds of thousands of simulations. These qualities make them unsuitable for large-scale simulations in economics and the social sciences, and can cast doubt on the validity of these inference methods in such scenarios. In this paper, we investigate the efficacy of two classes of simulation-efficient black-box approximate Bayesian inference methods that have recently drawn significant attention within the probabilistic machine learning community: neural posterior estimation and neural density ratio estimation. We present a number of benchmarking experiments in which we demonstrate that neural network-based black-box methods provide state of the art parameter inference for economic simulation models, and crucially are compatible with generic multivariate or even non-Euclidean time-series data. In addition, we suggest appropriate assessment criteria for use in future benchmarking of approximate Bayesian inference procedures for simulation models in economics and the social sciences.

Active Sequential Posterior Estimation for Sample-Efficient Simulation-Based Inference

Preconditioned Neural Posterior Estimation for Likelihood-free Inference

Cost-aware Simulation-based Inference

A Bayesian Stochastic Kriging Optimization Model Dealing with Heteroscedastic Simulation Noise for Freeway Traffic Management

Compositional simulation-based inference for time series

Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimation

Amortized Bayesian Decision Making for simulation-based models

Pseudo-Likelihood Inference

An efficient likelihood-free Bayesian inference method based on sequential neural posterior estimation

Fast, accurate and lightweight sequential simulation-based inference using Gaussian locally linear mappings

Deep Bayesian Active Learning for Accelerating Stochastic Simulation

Consistency Models for Scalable and Fast Simulation-Based Inference

Diffusion posterior sampling for simulation-based inference in tall data settings

Black-box Bayesian inference for agent-based models

Simulation-based inference with the Python Package sbijax

Scalable inference with Autoregressive Neural Ratio Estimation

Simultaneous identification of models and parameters of scientific simulators

Low-Budget Simulation-Based Inference with Bayesian Neural Networks

Misspecification-robust Sequential Neural Likelihood for Simulation-based Inference

Simulation-Based Inference with Neural Posterior Estimation applied to X-ray spectral fitting: Demonstration of working principles down to the Poisson regime