Abstract:The spatio-temporal interpolation of large geophysical datasets has historically been addressed by Optimal Interpolation (OI) and more sophisticated equation-based or data-driven Data Assimilation (DA) techniques. Recent advances in the deep learning community enables to address the interpolation problem through a neural architecture incorporating a variational data assimilation framework. The reconstruction task is seen as a joint learning problem of the prior involved in the variational inner cost, seen as a projection operator of the state, and the gradient-based minimization of the latter. Both prior models and solvers are stated as neural networks with automatic differentiation which can be trained by minimizing a loss function, typically the mean squared error between some ground truth and the reconstruction. Such a strategy turns out to be very efficient to improve the mean state estimation, but still needs complementary developments to quantify its related uncertainty. In this work, we use the theory of Stochastic Partial Differential Equations (SPDE) and Gaussian Processes (GP) to estimate both space-and time-varying covariance of the state. Our neural variational scheme is modified to embed an augmented state formulation with both state and SPDE parametrization to estimate. We demonstrate the potential of the proposed framework on a spatio-temporal GP driven by diffusion-based anisotropies and on realistic Sea Surface Height (SSH) datasets. We show how our solution reaches the OI baseline in the Gaussian case. For nonlinear dynamics, as almost always stated in DA, our solution outperforms OI, while allowing for fast and interpretable online parameter estimation.

Variational quantization for state space models

Variational quantum recurrent neural networks for multi-feature forecasting

Variational learning for switching state-space models

History Marginalization Improves Forecasting in Variational Recurrent Neural Networks

Learning Quantum Distributions with Variational Diffusion Models

Neural-network Variational Quantum Algorithm for Simulating Many-Body Dynamics

Adaptive time series forecasting with markovian variance switching

Streaming Variational Monte Carlo

Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting

Viking: Variational Bayesian Variance Tracking

A Composite Quantile Fourier Neural Network for Multi-Step Probabilistic Forecasting of Nonstationary Univariate Time Series

Variational Bayesian Quantization

Vector Quantized Time Series Generation with a Bidirectional Prior Model

Neural variational Data Assimilation with Uncertainty Quantification using SPDE priors

Continuous Variational Quantum Algorithms for Time Series

Variational Autoencoders for Efficient Simulation-Based Inference

QuaCK-TSF: Quantum-Classical Kernelized Time Series Forecasting

Variational Neural Stochastic Differential Equations with Change Points

Hybrid Variational Autoencoder for Time Series Forecasting

eXponential FAmily Dynamical Systems (XFADS): Large-scale nonlinear Gaussian state-space modeling