Abstract:Parallel Markov Chain Monte Carlo (pMCMC) algorithms generate clouds of proposals at each step to efficiently resolve a target probability distribution. We build a rigorous foundational framework for pMCMC algorithms that situates these methods within a unified 'extended phase space' measure-theoretic formalism. Drawing on our recent work that provides a comprehensive theory for reversible single proposal methods, we herein derive general criteria for multiproposal acceptance mechanisms which yield ergodic chains on general state spaces. Our formulation encompasses a variety of methodologies, including proposal cloud resampling and Hamiltonian methods, while providing a basis for the derivation of novel algorithms. In particular, we obtain a top-down picture for a class of methods arising from 'conditionally independent' proposal structures. As an immediate application, we identify several new algorithms including a multiproposal version of the popular preconditioned Crank-Nicolson (pCN) sampler suitable for high- and infinite-dimensional target measures which are absolutely continuous with respect to a Gaussian base measure. To supplement our theoretical results, we carry out a selection of numerical case studies that evaluate the efficacy of these novel algorithms. First, noting that the true potential of pMCMC algorithms arises from their natural parallelizability, we provide a limited parallelization study using TensorFlow and a graphics processing unit to scale pMCMC algorithms that leverage as many as 100k proposals at each step. Second, we use our multiproposal pCN algorithm (mpCN) to resolve a selection of problems in Bayesian statistical inversion for partial differential equations motivated by fluid measurement. These examples provide preliminary evidence of the efficacy of mpCN for high-dimensional target distributions featuring complex geometries and multimodal structures.

The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler Without Accept/Reject

The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler with a Near-Optimal L-Kernel

The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo

A General-Purpose Fixed-Lag No-U-Turn Sampler for Nonlinear Non-Gaussian State Space Models

On the convergence of dynamic implementations of Hamiltonian Monte Carlo and No U-Turn Samplers

A Single SMC Sampler on MPI that Outperforms a Single MCMC Sampler

Multicanonical sequential Monte Carlo sampler for uncertainty quantification

Multi-fidelity No-U-Turn Sampling

Tuning of MCMC with Langevin, Hamiltonian, and other stochastic autoregressive proposals

An invitation to sequential Monte Carlo samplers

A Neural Network MCMC Sampler That Maximizes Proposal Entropy

Waste-free Sequential Monte Carlo

ATLAS: Adapting Trajectory Lengths and Step-Size for Hamiltonian Monte Carlo

A Vine-Copula Based Adaptive Mcmc Sampler for Efficient Inference of Dynamical Systems

The Bouncy Particle Sampler: A Nonreversible Rejection-Free Markov Chain Monte Carlo Method

Parallel MCMC Algorithms: Theoretical Foundations, Algorithm Design, Case Studies

Delayed rejection schemes for efficient Markov-Chain Monte-Carlo sampling of multimodal distributions

Bouncy Hybrid Sampler as a Unifying Device

Bayesian Annealed Sequential Importance Sampling: An Unbiased Version of Transitional Markov Chain Monte Carlo

Sequential Monte Carlo with Highly Informative Observations

On sequential Monte Carlo, partial rejection control and approximate Bayesian computation