Abstract:Robust integration of physical knowledge and data is key to improve computational simulations, such as Earth system models. Data assimilation is crucial for achieving this goal because it provides a systematic framework to calibrate model outputs with observations, which can include remote sensing imagery and ground station measurements, with uncertainty quantification. Conventional methods, including Kalman filters and variational approaches, inherently rely on simplifying linear and Gaussian assumptions, and can be computationally expensive. Nevertheless, with the rapid adoption of data-driven methods in many areas of computational sciences, we see the potential of emulating traditional data assimilation with deep learning, especially generative models. In particular, the diffusion-based probabilistic framework has large overlaps with data assimilation principles: both allows for conditional generation of samples with a Bayesian inverse framework. These models have shown remarkable success in text-conditioned image generation or image-controlled video synthesis. Likewise, one can frame data assimilation as observation-conditioned state calibration. In this work, we propose SLAMS: Score-based Latent Assimilation in Multimodal Setting. Specifically, we assimilate in-situ weather station data and ex-situ satellite imagery to calibrate the vertical temperature profiles, globally. Through extensive ablation, we demonstrate that SLAMS is robust even in low-resolution, noisy, and sparse data settings. To our knowledge, our work is the first to apply deep generative framework for multimodal data assimilation using real-world datasets; an important step for building robust computational simulators, including the next-generation Earth system models. Our code is available at: <a class="link-external link-https" href="https://github.com/yongquan-qu/SLAMS" rel="external noopener nofollow">this https URL</a>

State-observation augmented diffusion model for nonlinear assimilation

Adaptive Multifidelity Data Assimilation for Nonlinear Subsurface Flow Problems

Deep Generative Data Assimilation in Multimodal Setting

Generalised Latent Assimilation in Heterogeneous Reduced Spaces with Machine Learning Surrogate Models

A structurally informed data assimilation approach for nonlinear partial differential equations

DiffDA: a Diffusion Model for Weather-scale Data Assimilation

Nonlinear Assimilation with Score-based Sequential Langevin Sampling

Observation Error Covariance Specification in Dynamical Systems for Data assimilation using Recurrent Neural Networks

A Closed-Form Nonlinear Data Assimilation Algorithm for Multi-Layer Flow Fields

Sequential data assimilation with multiple nonlinear models and applications to subsurface flow

Learning Dynamical Characteristics with Neural Operators for Data Assimilation

The Importance of Data Assimilation Components for Initial Conditions and Subsequent Error Growth

Latent diffusion models for parameterization of facies-based geomodels and their use in data assimilation

On conditional diffusion models for PDE simulations

Combining Stochastic Parameterized Reduced‐Order Models With Machine Learning for Data Assimilation and Uncertainty Quantification With Partial Observations

Latent diffusion models for parameterization and data assimilation of facies-based geomodels

Simultaneously Assimilating Multi-Source Observations into a Three-Dimensional Suspended Cohesive Sediment Transport Model by the Adjoint Method in the Bohai Sea

Generating Unseen Nonlinear Evolution in Sea Surface Temperature Using a Deep Learning-Based Latent Space Data Assimilation Framework

Projected Data Assimilation using Sliding Window Proper Orthogonal Decomposition

A Novel Deep Learning Approach for Data Assimilation of Complex Hydrological Systems