Abstract:Markov Chain Monte Carlo (MCMC) is a robust statistical approach for estimating posterior distributions. However, the significant computational cost associated with MCMC presents a considerable challenge, complicating the selection of an appropriate algorithm tailored to the specific problem at hand. This study introduces a novel and comprehensive framework for evaluating the performance of MCMC algorithms, drawing inspiration from diagnostics used for multi-objective evolutionary algorithms. We employ visualizations to evaluate key algorithmic characteristics: Effectiveness (the ability to accurately find representative posterior modes, quantified by the Kullback-Leibler Divergence (KLD) and Wasserstein Distance (WD)), Efficiency (the speed of posterior characterization), Reliability (consistency across different random seeds), and Controllability (insensitivity to hyperparameter variation). Evaluating three prominent MCMC algorithms—Metropolis-Hastings (MH), Adaptive Metropolis (AM), and Differential Evolution Adaptive Metropolis (DREAM)—on high-dimensional and bimodal test problems, our analysis uncovers several insights. First, across algorithms, the number of function evaluations most controls performance on the high-dimensional problem, while the number of chains most controls performance on the bimodal problem. While this suggests similar controllability across algorithms, differences emerge on the other algorithmic characteristics. For high numbers of functions evaluations, AM performs best on the high-dimensional problem, while for low ( 15) chain counts, MH and AM perform best on the bimodal problem, as measured by KLD. However, outside these specific cases, DREAM consistently demonstrates superior efficiency and reliability, making it a robust choice for both high-dimensional and multimodal problems. These findings can inform MCMC algorithm selection for Bayesian inference applications, as well as hyperparameterization of the chosen algorithm. More importantly, the diagnostics represent a generalizable contribution to research on MCMC diagnostics that can be used to evaluate and inform the design of new algorithms.

An Integrated Procedure for Bayesian Reliability Inference Using MCMC

Importance Sampling of Interval Markov Chains

Measuring the reliability of MCMC inference with bidirectional Monte Carlo

Bayesian Updating and Uncertainty Quantification using Sequential Tempered MCMC with the Rank-One Modified Metropolis Algorithm

Complex-valued Bayesian parameter estimation via Markov chain Monte Carlo

A Conceptual Introduction to Markov Chain Monte Carlo Methods

A Bayesian nonparametric system reliability model which integrates multiple sources of lifetime information

Bayesian Annealed Sequential Importance Sampling: An Unbiased Version of Transitional Markov Chain Monte Carlo

Data Analysis Recipes: Using Markov Chain Monte Carlo

Markov Chain Monte Carlo in Practice

Structural reliability analysis: A Bayesian perspective

Scalable Inference for Markov Processes with Intractable Likelihoods

Post-Processing of MCMC

Efficient History Matching Using the Markov-Chain Monte Carlo Method by Means of the Transformed Adaptive Stochastic Collocation Method

New Diagnostic Assessment of MCMC Algorithm Effectiveness, Efficiency, Reliability, and Controllability

Markov chain Monte Carlo methods in biostatistics

Bayesian inference of Stochastic reaction networks using Multifidelity Sequential Tempered Markov Chain Monte Carlo

Parallel MCMC Algorithms: Theoretical Foundations, Algorithm Design, Case Studies

Multilevel Monte Carlo for Reliability Theory

Integration of Active Learning and MCMC Sampling for Efficient Bayesian Calibration of Mechanical Properties

Improving Simulation Efficiency of MCMC for Inverse Modeling of Hydrologic Systems With a Kalman‐Inspired Proposal Distribution