Abstract:Models of stochastic processes are widely used in almost all fields of science. Theory validation, parameter estimation, and prediction all require model calibration and statistical inference using data. However, data are almost always incomplete observations of reality. This leads to a great challenge for statistical inference because the likelihood function will be intractable for almost all partially observed stochastic processes. This renders many statistical methods, especially within a Bayesian framework, impossible to implement. Therefore, computationally expensive likelihood-free approaches are applied that replace likelihood evaluations with realisations of the model and observation process. For accurate inference, however, likelihood-free techniques may require millions of expensive stochastic simulations. To address this challenge, we develop a new method based on recent advances in multilevel and multifidelity. Our approach combines the multilevel Monte Carlo telescoping summation, applied to a sequence of approximate Bayesian posterior targets, with a multifidelity rejection sampler to minimise the number of computationally expensive exact simulations required for accurate inference. We present the derivation of our new algorithm for likelihood-free Bayesian inference, discuss practical implementation details, and demonstrate substantial performance improvements. Using examples from systems biology, we demonstrate improvements of more than two orders of magnitude over standard rejection sampling techniques. Our approach is generally applicable to accelerate other sampling schemes, such as sequential Monte Carlo, to enable feasible Bayesian analysis for realistic practical applications in physics, chemistry, biology, epidemiology, ecology and economics.

Using deterministic approximations to accelerate SMC for posterior sampling

Sequential Monte Carlo with Highly Informative Observations

Sequential Monte Carlo for cut-Bayesian posterior computation

Stratified sampling and bootstrapping for approximate Bayesian computation

Persistent Sampling: Unleashing the Potential of Sequential Monte Carlo

Stratified distance space improves the efficiency of sequential samplers for approximate Bayesian computation

A Sequential Monte Carlo Algorithm to Incorporate Model Uncertainty in Bayesian Sequential Design

Informed sub-sampling MCMC: approximate Bayesian inference for large datasets

Multilevel Sequential${}^2$ Monte Carlo for Bayesian Inverse Problems

Accelerating sequential Monte Carlo with surrogate likelihoods

Towards Improved Uncertainty Quantification of Stochastic Epidemic Models Using Sequential Monte Carlo

SMC Is All You Need: Parallel Strong Scaling

Bayesian Annealed Sequential Importance Sampling: An Unbiased Version of Transitional Markov Chain Monte Carlo

Approximate Bayesian Computation for Smoothing

Approximating multivariate posterior distribution functions from Monte Carlo samples for sequential Bayesian inference

Accelerating delayed-acceptance Markov chain Monte Carlo algorithms

Approximate Bayesian Computation sequential Monte Carlo via random forests

A Vine-Copula Based Adaptive Mcmc Sampler for Efficient Inference of Dynamical Systems

Finding our Way in the Dark: Approximate MCMC for Approximate Bayesian Methods

Inference for SDE models via Approximate Bayesian Computation

Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes