Abstract:Simulation models, in particular agent-based models, are gaining popularity in economics and the social sciences. The considerable flexibility they offer, as well as their capacity to reproduce a variety of empirically observed behaviors of complex systems, give them broad appeal, and the increasing availability of cheap computing power has made their use feasible. Yet a widespread adoption in real-world modelling and decision-making scenarios has been hindered by the difficulty of performing parameter estimation for such models. In general, simulation models lack a tractable likelihood function, which precludes a straightforward application of standard statistical inference techniques. A number of recent works have sought to address this problem through the application of likelihood-free inference techniques, in which parameter estimates are determined by performing some form of comparison between the observed data and simulation output. However, these approaches are (a) founded on restrictive assumptions, and/or (b) typically require many hundreds of thousands of simulations. These qualities make them unsuitable for large-scale simulations in economics and the social sciences, and can cast doubt on the validity of these inference methods in such scenarios. In this paper, we investigate the efficacy of two classes of simulation-efficient black-box approximate Bayesian inference methods that have recently drawn significant attention within the probabilistic machine learning community: neural posterior estimation and neural density ratio estimation. We present a number of benchmarking experiments in which we demonstrate that neural network-based black-box methods provide state of the art parameter inference for economic simulation models, and crucially are compatible with generic multivariate or even non-Euclidean time-series data. In addition, we suggest appropriate assessment criteria for use in future benchmarking of approximate Bayesian inference procedures for simulation models in economics and the social sciences.

On Bayesian Inference for Continuous-Time Autoregressive Models Without Likelihood.

An easy-to-use empirical likelihood ABC method

Laplace Approximation for Conditional Autoregressive Models for Spatial Data of Diseases

Approximate Bayesian Computation via Classification

Likelihood free inference for Markov processes: a comparison

Bayesian Circular Lattice Filters for Computationally Efficient Estimation of Multivariate Time-Varying Autoregressive Models

Calibrating Car-Following Models Via Bayesian Dynamic Regression

Bayesian Lattice Filters for Time-Varying Autoregression and Time-Frequency Analysis

On the relationship between conditional (CAR) and simultaneous (SAR) autoregressive models

Diagnostic analystics in the Bayesian vector autoregressive model

Black-box Bayesian inference for agent-based models

Approximate Bayesian Computation by Subset Simulation for Parameter Inference of Dynamical Models

Empirical Likelihood Inference for INAR(1) Model with Explanatory Variables

The Circumstance-Driven Bivariate Integer-Valued Autoregressive Model

Beta Autoregressive Fractionally Integrated Moving Average Models

Mixing Times and Structural Inference for Bernoulli Autoregressive Processes

Using Early Rejection Markov Chain Monte Carlo and Gaussian Processes to Accelerate ABC Methods

Parameter estimation for Gipps' car following model in a Bayesian framework

Parameter Estimation and Model Testing for Markov Processes Via Conditional Characteristic Functions

Bayesian-INLA Estimation of Varying Coefficient Spatial Autocorrelation Model

Efficient Bayesian inference for long memory processes