Abstract:In this paper we develop set of novel Markov chain Monte Carlo algorithms for Bayesian smoothing of partially observed non-linear diffusion processes. The sampling algorithms developed herein use a deterministic approximation to the posterior distribution over paths as the proposal distribution for a mixture of an independence and a random walk sampler. The approximating distribution is sampled by simulating an optimized time-dependent linear diffusion process derived from the recently developed variational Gaussian process approximation method. The novel diffusion bridge proposal derived from the variational approximation allows the use of a flexible blocking strategy that further improves mixing, and thus the efficiency, of the sampling algorithms. The algorithms are tested on two diffusion processes: one with double-well potential drift and another with SINE drift. The new algorithm’s accuracy and efficiency is compared with state-of-the-art hybrid Monte Carlo based path sampling. It is shown that in practical, finite sample applications the algorithm is accurate except in the presence of large observation errors and low observation densities, which lead to a multi-modal structure in the posterior distribution over paths. More importantly, the variational approximation assisted sampling algorithm outperforms hybrid Monte Carlo in terms of computational efficiency, except when the diffusion process is densely observed with small errors in which case both algorithms are equally efficient.

Variational Bayesian Inversion for the Reaction Coefficient in Space-Time Nonlocal Diffusion Equations

Application of Bayesian Inference to Estimate the Parameters in 2D Convection-diffusion Equation with Source

Consistency of variational Bayesian inference for non-linear inverse problems of partial differential equations

On an inverse potential problem for a fractional reaction–diffusion equation

Bayesian inversion of a diffusion model with application to biology

Nonparametric calibration for stochastic reaction-diffusion equations based on discrete observations

Variational Inference for Diffusion Processes.

Sparse identification of nonlocal interaction kernels in nonlinear gradient flow equations via partial inversion

A stabilized semi-implicit Fourier spectral method for nonlinear space-fractional reaction-diffusion equations

A novel bond-based nonlocal diffusion model with matrix-valued coefficients in non-divergence form and its collocation discretization

Nonparametric Bayesian estimation in a multidimensional diffusion model with high frequency data

Inverse Coefficient Problem for One-Dimensional Subdiffusion with Data on Disjoint Sets in Time

Uniqueness and stabilized algorithm for an inverse problem of identifying space-time dependent diffusion coefficients

Nonlinear nonlocal reaction-diffusion problem with local reaction

Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems

Variational Markov chain Monte Carlo for Bayesian smoothing of non-linear diffusions

A variational approach to sampling in diffusion processes

Non-parametric estimation of the reaction term in semi-linear SPDEs with spatial ergodicity

Partial data inverse problems for reaction-diffusion and heat equations

On the Features of Numerical Solution of Coefficient Inverse Problems for Nonlinear Equations of the Reaction–Diffusion–Advection Type with Data of Various Types