Abstract:Bayesian analysis is widely used in science and engineering for real‐time forecasting, decision making, and to help unravel the processes that explain the observed data. These data are some deterministic and/or stochastic transformations of the underlying parameters. A key task is then to summarize the posterior distribution of these parameters. When models become too difficult to analyze analytically, Monte Carlo methods can be used to approximate the target distribution. Of these, Markov chain Monte Carlo (MCMC) methods are particularly powerful. Such methods generate a random walk through the parameter space and, under strict conditions of reversibility and ergodicity, will successively visit solutions with frequency proportional to the underlying target density. This requires a proposal distribution that generates candidate solutions starting from an arbitrary initial state. The speed of the sampled chains converging to the target distribution deteriorates rapidly, however, with increasing parameter dimensionality. In this paper, we introduce a new proposal distribution that enhances significantly the efficiency of MCMC simulation for highly parameterized models. This proposal distribution exploits the cross covariance of model parameters, measurements, and model outputs and generates candidate states much alike the analysis step in the Kalman filter. We embed the Kalman‐inspired proposal distribution in the DiffeRential Evolution Adaptive Metropolis algorithm during burn‐in and present several numerical experiments with complex, high‐dimensional, or multimodal target distributions. Results demonstrate that this new proposal distribution can greatly improve simulation efficiency of MCMC. Specifically, we observe a speedup on the order of 10–30 times for groundwater models with more than 100 parameters. MCMC methods remain rather inefficient in exploring high‐dimensional target distributions This paper introduces a Kalman‐inspired proposal distribution to improve the simulation efficiency of MCMC The Kalman‐inspired proposal distribution can be conveniently embedded in any adequate MCMC method

MCMC for a hyperbolic Bayesian inverse problem in traffic flow modelling

A Bayesian Stochastic Kriging Optimization Model Dealing with Heteroscedastic Simulation Noise for Freeway Traffic Management

Efficient, multimodal, and derivative-free Bayesian inference with Fisher-Rao gradient flows

Bayesian analysis of traffic flow on interstate I-55: The LWR model

Fast Bayesian estimation of spatial count data models

HJ-sampler: A Bayesian sampler for inverse problems of a stochastic process by leveraging Hamilton-Jacobi PDEs and score-based generative models

Multiscale model reduction method for Bayesian inverse problems of subsurface flow

An integrated Bayesian approach for passenger flow assignment in metro networks

Improving Simulation Efficiency of MCMC for Inverse Modeling of Hydrologic Systems With a Kalman‐Inspired Proposal Distribution

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Change of Measure for Bayesian Field Inversion with Hierarchical Hyperparameters Sampling

Multilevel Markov Chain Monte Carlo for Bayesian inverse problems for Navier Stokes equation with Lagrangian Observations

Scalable Bayesian modeling, monitoring and analysis of dynamic network flow data

Parameter and density estimation from real-world traffic data: A kinetic compartmental approach

Stochastic Gradient Geodesic MCMC Methods.

Parameter estimation for Gipps' car following model in a Bayesian framework

Optimization-Based MCMC Methods for Nonlinear Hierarchical Statistical Inverse Problems

Multilevel Sequential${}^2$ Monte Carlo for Bayesian Inverse Problems

An Auxiliary Variable Method for Markov Chain Monte Carlo Algorithms in High Dimension

An improved implicit sampling for Bayesian inverse problems of multi-term time fractional multiscale diffusion models