Abstract:Background: In quantitative biology, mathematical models are used to describe and analyze biological processes. The parameters of these models are usually unknown and need to be estimated from experimental data using statistical methods. In particular, Markov chain Monte Carlo (MCMC) methods have become increasingly popular as they allow for a rigorous analysis of parameter and prediction uncertainties without the need for assuming parameter identifiability or removing non-identifiable parameters. A broad spectrum of MCMC algorithms have been proposed, including single- and multi-chain approaches. However, selecting and tuning sampling algorithms suited for a given problem remains challenging and a comprehensive comparison of different methods is so far not available. Results: We present the results of a thorough benchmarking of state-of-the-art single- and multi-chain sampling methods, including Adaptive Metropolis, Delayed Rejection Adaptive Metropolis, Metropolis adjusted Langevin algorithm, Parallel Tempering and Parallel Hierarchical Sampling. Different initialization and adaptation schemes are considered. To ensure a comprehensive and fair comparison, we consider problems with a range of features such as bifurcations, periodical orbits, multistability of steady-state solutions and chaotic regimes. These problem properties give rise to various posterior distributions including uni- and multi-modal distributions and non-normally distributed mode tails. For an objective comparison, we developed a pipeline for the semi-automatic comparison of sampling results. Conclusion: The comparison of MCMC algorithms, initialization and adaptation schemes revealed that overall multi-chain algorithms perform better than single-chain algorithms. In some cases this performance can be further increased by using a preceding multi-start local optimization scheme. These results can inform the selection of sampling methods and the benchmark collection can serve for the evaluation of new algorithms. Furthermore, our results confirm the need to address exploration quality of MCMC chains before applying the commonly used quality measure of effective sample size to prevent false analysis conclusions.

Markov Chain Monte Carlo Optimization applied to Dyson's Visual Double Stars

Markov Chain Monte Carlo optimization applied to double stars from Miller & Pitman research

Markov Chain Monte Carlo applied to the Double Stars of Miller and Pitman

Looking for Stable Celestial Systems Using Bayesian Optimisation

RUN DMC: An efficient, parallel code for analyzing Radial Velocity Observations using N-body Integrations and Differential Evolution Markov chain Monte Carlo

Markov Chain Monte Carlo for Bayesian Parametric Galaxy Modeling in LSST

Genetic-Algorithm-based Light Curve Optimization Applied to Observations of the W UMa star BH Cas

Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy

A Method to Improve Binary Orbits by Incorporating Long-term Observational Data

A Comparison of Variational and Markov Chain Monte Carlo Methods for Inference in Partially Observed Stochastic Dynamic Systems

A Method of Determining Binary Orbits by incorporating Long-term Observational Data

Comprehensive benchmarking of Markov chain Monte Carlo methods for dynamical systems

Bayesian Synthesis of Astrometric Wobble and Total Light Curves in Close Binary Supermassive Black Holes

Markov Chain Monte Carlo and Variational Inference: Bridging the Gap

Bayesian inference of T Tauri star properties using multi-wavelength survey photometry

"Parallel-Tempering"-Assisted Hybrid Monte Carlo Algorithm For Bayesian Inference In Dynamical Systems

A Stochastic Monte Carlo Approach to Modelling Real Star Cluster Evolution -- III. Direct Integration of Three- and Four-Body Interactions

Characterizing Low-Mass Binaries from Observation of Long Time-scale Caustic-crossing Gravitational Microlensing Events

New methods for radial-velocity measurements of double-lined binaries, and detection of a circumbinary planet orbiting TIC 172900988

An Analytic Model for Rotational Modulations in the Photometry of Spotted Stars