Abstract:In this paper we develop set of novel Markov chain Monte Carlo algorithms for Bayesian smoothing of partially observed non-linear diffusion processes. The sampling algorithms developed herein use a deterministic approximation to the posterior distribution over paths as the proposal distribution for a mixture of an independence and a random walk sampler. The approximating distribution is sampled by simulating an optimized time-dependent linear diffusion process derived from the recently developed variational Gaussian process approximation method. The novel diffusion bridge proposal derived from the variational approximation allows the use of a flexible blocking strategy that further improves mixing, and thus the efficiency, of the sampling algorithms. The algorithms are tested on two diffusion processes: one with double-well potential drift and another with SINE drift. The new algorithm’s accuracy and efficiency is compared with state-of-the-art hybrid Monte Carlo based path sampling. It is shown that in practical, finite sample applications the algorithm is accurate except in the presence of large observation errors and low observation densities, which lead to a multi-modal structure in the posterior distribution over paths. More importantly, the variational approximation assisted sampling algorithm outperforms hybrid Monte Carlo in terms of computational efficiency, except when the diffusion process is densely observed with small errors in which case both algorithms are equally efficient.

Markov chain approximations for one dimensional diffusions

The Euler-Maruyama Approximation of State-Dependent Regime Switching Diffusions

STRONG APPROXIMATION OF A MARKOV CHAIN

Variational Markov chain Monte Carlo for Bayesian smoothing of non-linear diffusions

Accuracy of Diffusion Approximations for High Frequency Markov Data

Intrinsic Metric and One-Dimensional Diffusions

Discrete approximation of reflected Brownian motions by Markov chains on partitions of domains

Resolvent approach to diffusions with discontinuous scale

Markov Chains Approximations of jump-Diffusion Quantum Trajectories

Density Approximations for Multivariate Diffusions Via an Ito-Taylor Expansion Approach

Dirichlet form approach to diffusions with discontinuous scale

Approximation to the linear fractional self-attracting diffusion

Carr-Nadtochiy's Weak Reflection Principle for Markov Chains on $\mathbf{Z}^d$

Stein's method for steady-state diffusion approximation in Wasserstein distance

Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting

Stochastic generalized Kolmogorov systems with small diffusion: I. Explicit approximations for invariant probability density function

Markov Chain Approximation of Pure Jump Processes

Weak approximation for stochastic reaction-diffusion equation near sharp interface limit

Boundary crossing probabilities for diffusions with piecewise linear drifts

The Diffusion Coefficient For Piecewise Expanding Maps Of The Interval With Metastable States

Markov chain approximations to singular stable-like processes