Abstract:Robust integration of physical knowledge and data is key to improve computational simulations, such as Earth system models. Data assimilation is crucial for achieving this goal because it provides a systematic framework to calibrate model outputs with observations, which can include remote sensing imagery and ground station measurements, with uncertainty quantification. Conventional methods, including Kalman filters and variational approaches, inherently rely on simplifying linear and Gaussian assumptions, and can be computationally expensive. Nevertheless, with the rapid adoption of data-driven methods in many areas of computational sciences, we see the potential of emulating traditional data assimilation with deep learning, especially generative models. In particular, the diffusion-based probabilistic framework has large overlaps with data assimilation principles: both allows for conditional generation of samples with a Bayesian inverse framework. These models have shown remarkable success in text-conditioned image generation or image-controlled video synthesis. Likewise, one can frame data assimilation as observation-conditioned state calibration. In this work, we propose SLAMS: Score-based Latent Assimilation in Multimodal Setting. Specifically, we assimilate in-situ weather station data and ex-situ satellite imagery to calibrate the vertical temperature profiles, globally. Through extensive ablation, we demonstrate that SLAMS is robust even in low-resolution, noisy, and sparse data settings. To our knowledge, our work is the first to apply deep generative framework for multimodal data assimilation using real-world datasets; an important step for building robust computational simulators, including the next-generation Earth system models. Our code is available at: <a class="link-external link-https" href="https://github.com/yongquan-qu/SLAMS" rel="external noopener nofollow">this https URL</a>

Surrogate modeling for the climate sciences dynamics with machine learning and data assimilation

Efficient surrogate modeling methods for large-scale Earth system models based on machine learning techniques

A deep learning-based surrogate model for seismic data assimilation in fault activation modeling

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Surrogate-Based Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Structural Error.

A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problems

HYBRID MODELING: FUSION OF A DEEP LEARNING APPROACH AND A PHYSICS-BASED MODEL FOR GLOBAL HYDROLOGICAL MODELING

A Hybrid Atmospheric Model Incorporating Machine Learning Can Capture Dynamical Processes Not Captured by Its Physics‐Based Component

Graph Convolutional Neural Networks as Surrogate Models for Climate Simulation

Machine learning surrogates for efficient hydrologic modeling: Insights from stochastic simulations of managed aquifer recharge

Combining machine learning with knowledge-based modeling for scalable forecasting and subgrid-scale closure of large, complex, spatiotemporal systems

Deep learning and process understanding for data-driven Earth system science

Causally-informed deep learning to improve climate models and projections

Causally‐Informed Deep Learning to Improve Climate Models and Projections

Generalised Latent Assimilation in Heterogeneous Reduced Spaces with Machine Learning Surrogate Models

Deep Generative Data Assimilation in Multimodal Setting

Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review

A Non‐Intrusive Machine Learning Framework for Debiasing Long‐Time Coarse Resolution Climate Simulations and Quantifying Rare Events Statistics

A Novel Framework for Spatio-Temporal Prediction of Environmental Data Using Deep Learning

Training Deep Surrogate Models with Large Scale Online Learning

Accelerating Subglacial Hydrology for Ice Sheet Models With Deep Learning Methods