Abstract:The interplay between stochastic processes and optimal control has been extensively explored in the literature. With the recent surge in the use of diffusion models, stochastic processes have increasingly been applied to sample generation. This paper builds on the log transform, known as the Cole-Hopf transform in Brownian motion contexts, and extends it within a more abstract framework that includes a linear operator. Within this framework, we found that the well-known relationship between the Cole-Hopf transform and optimal transport is a particular instance where the linear operator acts as the infinitesimal generator of a stochastic process. We also introduce a novel scenario where the linear operator is the adjoint of the generator, linking to Bayesian inference under specific initial and terminal conditions. Leveraging this theoretical foundation, we develop a new algorithm, named the HJ-sampler, for Bayesian inference for the inverse problem of a stochastic differential equation with given terminal observations. The HJ-sampler involves two stages: (1) solving the viscous Hamilton-Jacobi partial differential equations, and (2) sampling from the associated stochastic optimal control problem. Our proposed algorithm naturally allows for flexibility in selecting the numerical solver for viscous HJ PDEs. We introduce two variants of the solver: the Riccati-HJ-sampler, based on the Riccati method, and the SGM-HJ-sampler, which utilizes diffusion models. We demonstrate the effectiveness and flexibility of the proposed methods by applying them to solve Bayesian inverse problems involving various stochastic processes and prior distributions, including applications that address model misspecifications and quantifying model uncertainty.

Ensemble sampler for infinite-dimensional inverse problems

Ensemble-based implicit sampling for Bayesian inverse problems with non-Gaussian priors

Interacting Langevin Diffusions: Gradient Structure And Ensemble Kalman Sampler

HJ-sampler: A Bayesian sampler for inverse problems of a stochastic process by leveraging Hamilton-Jacobi PDEs and score-based generative models

Infinite dimensional adaptive MCMC for Gaussian processes

A Vine-Copula Based Adaptive Mcmc Sampler for Efficient Inference of Dynamical Systems

A fast asynchronous MCMC sampler for sparse Bayesian inference

Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems

Ensemble Slice Sampling: Parallel, black-box and gradient-free inference for correlated & multimodal distributions

Ensemble Kalman filter for multiscale inverse problems

Multilevel Sequential${}^2$ Monte Carlo for Bayesian Inverse Problems

Conditional score-based diffusion models for Bayesian inference in infinite dimensions

Enhancing Score-Based Sampling Methods with Ensembles

Ensemble preconditioning for Markov chain Monte Carlo simulation

Properties of the affine‐invariant ensemble sampler's ‘stretch move’ in high dimensions

Ai-Sampler: Adversarial Learning of Markov kernels with involutive maps

Sampling Approximately Low-Rank Ising Models: MCMC meets Variational Methods

Auxiliary MCMC and particle Gibbs samplers for parallelisable inference in latent dynamical systems

Subsampling in ensemble Kalman inversion

Less interaction with forward models in Langevin dynamics

Infinite dimensional Piecewise Deterministic Markov Processes