Abstract:Bayesian analysis is widely used in science and engineering for real‐time forecasting, decision making, and to help unravel the processes that explain the observed data. These data are some deterministic and/or stochastic transformations of the underlying parameters. A key task is then to summarize the posterior distribution of these parameters. When models become too difficult to analyze analytically, Monte Carlo methods can be used to approximate the target distribution. Of these, Markov chain Monte Carlo (MCMC) methods are particularly powerful. Such methods generate a random walk through the parameter space and, under strict conditions of reversibility and ergodicity, will successively visit solutions with frequency proportional to the underlying target density. This requires a proposal distribution that generates candidate solutions starting from an arbitrary initial state. The speed of the sampled chains converging to the target distribution deteriorates rapidly, however, with increasing parameter dimensionality. In this paper, we introduce a new proposal distribution that enhances significantly the efficiency of MCMC simulation for highly parameterized models. This proposal distribution exploits the cross covariance of model parameters, measurements, and model outputs and generates candidate states much alike the analysis step in the Kalman filter. We embed the Kalman‐inspired proposal distribution in the DiffeRential Evolution Adaptive Metropolis algorithm during burn‐in and present several numerical experiments with complex, high‐dimensional, or multimodal target distributions. Results demonstrate that this new proposal distribution can greatly improve simulation efficiency of MCMC. Specifically, we observe a speedup on the order of 10–30 times for groundwater models with more than 100 parameters. MCMC methods remain rather inefficient in exploring high‐dimensional target distributions This paper introduces a Kalman‐inspired proposal distribution to improve the simulation efficiency of MCMC The Kalman‐inspired proposal distribution can be conveniently embedded in any adequate MCMC method

Efficient Sequential Monte Carlo With Multiple Proposals and Control Variates

Adaptive sequential Monte Carlo by means of mixture of experts

The Sequential Monte Carlo Multi-Bernoulli Filter For Extended Targets

Sequential Monte Carlo with Highly Informative Observations

On sequential Monte Carlo sampling methods for Bayesian filtering

Enhanced SMC$^2$: Leveraging Gradient Information from Differentiable Particle Filters Within Langevin Proposals

The Application of Zig-Zag Sampler in Sequential Markov Chain Monte Carlo

Improving Simulation Efficiency of MCMC for Inverse Modeling of Hydrologic Systems With a Kalman‐Inspired Proposal Distribution

Tuning of MCMC with Langevin, Hamiltonian, and other stochastic autoregressive proposals

Particle Filter with Hybrid Proposal Distribution for Nonlinear State Estimation.

An Efficient Measurement-Driven Sequential Monte Carlo Multi-Bernoulli Filter for Multi-Target Filtering

The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler with a Near-Optimal L-Kernel

Differentiable Interacting Multiple Model Particle Filtering

Distributed Robust Bayesian Filtering for State Estimation.

A General-Purpose Fixed-Lag No-U-Turn Sampler for Nonlinear Non-Gaussian State Space Models

An invitation to sequential Monte Carlo samplers

Quasi-Monte Carlo particle filter algorithm based on sigma point H∞

The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler Without Accept/Reject

A Multilevel Homotopy MCMC Sequential Monte Carlo Filter for Multi-Target Tracking

Online Variational Sequential Monte Carlo

Parallel MCMC Algorithms: Theoretical Foundations, Algorithm Design, Case Studies