Abstract:Background: In quantitative biology, mathematical models are used to describe and analyze biological processes. The parameters of these models are usually unknown and need to be estimated from experimental data using statistical methods. In particular, Markov chain Monte Carlo (MCMC) methods have become increasingly popular as they allow for a rigorous analysis of parameter and prediction uncertainties without the need for assuming parameter identifiability or removing non-identifiable parameters. A broad spectrum of MCMC algorithms have been proposed, including single- and multi-chain approaches. However, selecting and tuning sampling algorithms suited for a given problem remains challenging and a comprehensive comparison of different methods is so far not available. Results: We present the results of a thorough benchmarking of state-of-the-art single- and multi-chain sampling methods, including Adaptive Metropolis, Delayed Rejection Adaptive Metropolis, Metropolis adjusted Langevin algorithm, Parallel Tempering and Parallel Hierarchical Sampling. Different initialization and adaptation schemes are considered. To ensure a comprehensive and fair comparison, we consider problems with a range of features such as bifurcations, periodical orbits, multistability of steady-state solutions and chaotic regimes. These problem properties give rise to various posterior distributions including uni- and multi-modal distributions and non-normally distributed mode tails. For an objective comparison, we developed a pipeline for the semi-automatic comparison of sampling results. Conclusion: The comparison of MCMC algorithms, initialization and adaptation schemes revealed that overall multi-chain algorithms perform better than single-chain algorithms. In some cases this performance can be further increased by using a preceding multi-start local optimization scheme. These results can inform the selection of sampling methods and the benchmark collection can serve for the evaluation of new algorithms. Furthermore, our results confirm the need to address exploration quality of MCMC chains before applying the commonly used quality measure of effective sample size to prevent false analysis conclusions.

Improved MCMC Method and Its Application

The Parameters Optimization in Hydrogeological Model Based on MCMC Method

Efficient History Matching Using the Markov-Chain Monte Carlo Method by Means of the Transformed Adaptive Stochastic Collocation Method

Improving Simulation Efficiency of MCMC for Inverse Modeling of Hydrologic Systems With a Kalman‐Inspired Proposal Distribution

Inverse modeling of hydrologic systems with adaptive multi-fidelity Markov chain Monte Carlo simulations

Mixed Gaussian stochastic inversion based on hybrid of cuckoo algorithm and Markov chain Monte Carlo

Efficient Bayesian Inverse Modeling of Water Infiltration in Layered Soils

An Improved Markov Chain Monte Carlo Scheme for Parameter Estimation Analysis

Comprehensive benchmarking of Markov chain Monte Carlo methods for dynamical systems

Markov Chain Monte Carlo in Practice

Accelerating Multilevel Markov Chain Monte Carlo Using Machine Learning Models

A quantitative study on the approximation error and speed-up of the multi-scale MCMC (Monte Carlo Markov chain) method for molecular dynamics

Improving sample efficiency of high dimensional Bayesian optimization with MCMC

A Hybrid Stochastic Gradient Hamiltonian Monte Carlo Method

2D probabilistic inversion of MT data and uncertainty quantification using the Hamiltonian Monte Carlo method

Improved coupled Markov chain method for simulating geological uncertainty

An improved implicit sampling for Bayesian inverse problems of multi-term time fractional multiscale diffusion models

Markov Chain Monte Carlo scheme for parameter uncertainty analysis in water quality model]

Geological structure-guided hybrid MCMC and Bayesian linearized inversion methodology

A Multi-armed Bandit MCMC, with applications in sampling from doubly intractable posterior

Sequential pCN-MCMC, an efficient MCMC method for Bayesian inversion of high-dimensional multi-Gaussian priors