Abstract:We present a novel variational framework for performing inference in (neural) stochastic differential equations (SDEs) driven by Markov-approximate fractional Brownian motion (fBM). SDEs offer a versatile tool for modeling real-world continuous-time dynamic systems with inherent noise and randomness. Combining SDEs with the powerful inference capabilities of variational methods, enables the learning of representative function distributions through stochastic gradient descent. However, conventional SDEs typically assume the underlying noise to follow a Brownian motion (BM), which hinders their ability to capture long-term dependencies. In contrast, fractional Brownian motion (fBM) extends BM to encompass non-Markovian dynamics, but existing methods for inferring fBM parameters are either computationally demanding or statistically inefficient. In this paper, building upon the Markov approximation of fBM, we derive the evidence lower bound essential for efficient variational inference of posterior path measures, drawing from the well-established field of stochastic analysis. Additionally, we provide a closed-form expression to determine optimal approximation coefficients. Furthermore, we propose the use of neural networks to learn the drift, diffusion and control terms within our variational posterior, leading to the variational training of neural-SDEs. In this framework, we also optimize the Hurst index, governing the nature of our fractional noise. Beyond validation on synthetic data, we contribute a novel architecture for variational latent video prediction,-an approach that, to the best of our knowledge, enables the first variational neural-SDE application to video perception.

A Comparison of Variational and Markov Chain Monte Carlo Methods for Inference in Partially Observed Stochastic Dynamic Systems

Variational Markov chain Monte Carlo for Bayesian smoothing of non-linear diffusions

Markov Chain Monte Carlo and Variational Inference: Bridging the Gap

A Vine-Copula Based Adaptive Mcmc Sampler for Efficient Inference of Dynamical Systems

Variational Bayesian Inference for Partially Observed Diusions

Dynamic Variational Bayesian Student's T Mixture Regression With Hidden Variables Propagation for Industrial Inferential Sensor Development

Efficient Variational Bayesian Model Updating by Bayesian Active Learning

Variational mcmc

Variational Inference for SDEs Driven by Fractional Noise

Bayesian parameter inference for partially observed stochastic differential equations driven by fractional Brownian motion

Markov Chain Monte Carlo for Continuous-Time Switching Dynamical Systems

Variational Bayesian inference with stochastic search

Variational Inference for Stochastic Differential Equations

Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo

Variational Inference for Continuous-Time Switching Dynamical Systems

Scalable Bayesian Learning for State Space Models using Variational Inference with SMC Samplers

Robust Coordinate Ascent Variational Inference with Markov chain Monte Carlo simulations

Gaussian filtering and variational approximations for Bayesian smoothing in continuous-discrete stochastic dynamic systems

Kinetic interacting particle system: parameter estimation from complete and partial discrete observations

Bayesian parameter inference for partially observed stochastic volterra equations

Black-box Variational Inference for Stochastic Differential Equations