Abstract:Models of stochastic processes are widely used in almost all fields of science. Theory validation, parameter estimation, and prediction all require model calibration and statistical inference using data. However, data are almost always incomplete observations of reality. This leads to a great challenge for statistical inference because the likelihood function will be intractable for almost all partially observed stochastic processes. This renders many statistical methods, especially within a Bayesian framework, impossible to implement. Therefore, computationally expensive likelihood-free approaches are applied that replace likelihood evaluations with realisations of the model and observation process. For accurate inference, however, likelihood-free techniques may require millions of expensive stochastic simulations. To address this challenge, we develop a new method based on recent advances in multilevel and multifidelity. Our approach combines the multilevel Monte Carlo telescoping summation, applied to a sequence of approximate Bayesian posterior targets, with a multifidelity rejection sampler to minimise the number of computationally expensive exact simulations required for accurate inference. We present the derivation of our new algorithm for likelihood-free Bayesian inference, discuss practical implementation details, and demonstrate substantial performance improvements. Using examples from systems biology, we demonstrate improvements of more than two orders of magnitude over standard rejection sampling techniques. Our approach is generally applicable to accelerate other sampling schemes, such as sequential Monte Carlo, to enable feasible Bayesian analysis for realistic practical applications in physics, chemistry, biology, epidemiology, ecology and economics.

Computationally efficient reductions between some statistical models

Parametric/Stochastic Model Reduction: Low-Rank Representation, Non-Intrusive Bi-Fidelity Approximation, and Convergence Analysis

Probability Distance Based Compression of Hidden Markov Models

Approximate Laplace approximations for scalable model selection

Sampling-free parametric model reduction for structured systems

Model reduction of coupled systems based on non-intrusive approximations of the boundary response maps

On Statistical Efficiency in Learning

Local-global model reduction method for stochastic optimal control problems constrained by partial differential equations

Variance Reduction for the Independent Metropolis Sampler

On efficient dimension reduction with respect to a statistical functional of interest

Rapid Bayesian inference for expensive stochastic models

Statistical and Computational Trade-offs in Variational Inference: A Case Study in Inferential Model Selection

Structured Projection-Based Model Reduction with Application to Stochastic Biochemical Networks

Projection-Based Model Reduction with Dynamically Transformed Modes

Exact Model Reduction for Continuous-Time Open Quantum Dynamics

Non-linear regression models for Approximate Bayesian Computation

Model Reduction for Quantum Systems: Discrete-time Quantum Walks and Open Markov Dynamics

Information-Theoretic Approach for Model Reduction Over Finite Time Horizon

On the role of eigenvalue disparity and coordinate transformations in the reduction of the linear noise approximation

Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes

A hybrid approach to model reduction of Generalized Langevin Dynamics