Abstract:Markov Chain Monte Carlo (MCMC) is a robust statistical approach for estimating posterior distributions. However, the significant computational cost associated with MCMC presents a considerable challenge, complicating the selection of an appropriate algorithm tailored to the specific problem at hand. This study introduces a novel and comprehensive framework for evaluating the performance of MCMC algorithms, drawing inspiration from diagnostics used for multi-objective evolutionary algorithms. We employ visualizations to evaluate key algorithmic characteristics: Effectiveness (the ability to accurately find representative posterior modes, quantified by the Kullback-Leibler Divergence (KLD) and Wasserstein Distance (WD)), Efficiency (the speed of posterior characterization), Reliability (consistency across different random seeds), and Controllability (insensitivity to hyperparameter variation). Evaluating three prominent MCMC algorithms—Metropolis-Hastings (MH), Adaptive Metropolis (AM), and Differential Evolution Adaptive Metropolis (DREAM)—on high-dimensional and bimodal test problems, our analysis uncovers several insights. First, across algorithms, the number of function evaluations most controls performance on the high-dimensional problem, while the number of chains most controls performance on the bimodal problem. While this suggests similar controllability across algorithms, differences emerge on the other algorithmic characteristics. For high numbers of functions evaluations, AM performs best on the high-dimensional problem, while for low ( 15) chain counts, MH and AM perform best on the bimodal problem, as measured by KLD. However, outside these specific cases, DREAM consistently demonstrates superior efficiency and reliability, making it a robust choice for both high-dimensional and multimodal problems. These findings can inform MCMC algorithm selection for Bayesian inference applications, as well as hyperparameterization of the chosen algorithm. More importantly, the diagnostics represent a generalizable contribution to research on MCMC diagnostics that can be used to evaluate and inform the design of new algorithms.

Hamiltonian sequential Monte Carlo with application to consumer choice behavior

SEQUENTIAL MONTE CARLO METHODS AND THEIR APPLICATIONS

Learning Hamiltonian Monte Carlo in R

Sequential Monte Carlo with Highly Informative Observations

Simulation based sequential Monte Carlo methods for discretely observed Markov processes

Sequential Monte Carlo for cut-Bayesian posterior computation

Stochastic Approximation Hamiltonian Monte Carlo

Some Contributions to Sequential Monte Carlo Methods for Option Pricing

Multi-fidelity Hamiltonian Monte Carlo

Efficient History Matching Using the Markov-Chain Monte Carlo Method by Means of the Transformed Adaptive Stochastic Collocation Method

Persistent Sampling: Unleashing the Potential of Sequential Monte Carlo

Quasi-Newton Hamiltonian Monte Carlo.

Stochastic Gradient Markov Chain Monte Carlo

Robust Inference of Dynamic Covariance Using Wishart Processes and Sequential Monte Carlo

A Sequential Monte Carlo Algorithm to Incorporate Model Uncertainty in Bayesian Sequential Design

Elements of Sequential Monte Carlo

Convergence Analysis of Markov Chain Monte Carlo Estimators of Discrete Choice Models in Transportation

Stochastic Gradient MCMC for Nonlinear State Space Models

Parallel Markov Chain Monte Carlo for Non-Gaussian Posterior Distributions

New Diagnostic Assessment of MCMC Algorithm Effectiveness, Efficiency, Reliability, and Controllability

Hamiltonian Monte Carlo Inference of Marginalized Linear Mixed-Effects Models