Abstract:Remote sensing data play a critical role in improving numerical weather prediction (NWP). However, the physical principles of radiation dictate that data voids frequently exist in physical space (e.g., subcloud area for satellite infrared radiance or no-precipitation region for radar reflectivity). Such data gaps impair the accuracy of initial conditions derived from data assimilation (DA), which has a negative impact on NWP. We use the barotropic vorticity equation to demonstrate the potential of deep learning augmented data assimilation (DDA), which involves reconstructing spatially complete pseudo-observation fields from incomplete observations and using them for DA. By training a convolutional autoencoder (CAE) with a long simulation at a coarse "forecast" resolution (T63), we obtained a deep learning approximation of the "reconstruction operator," which maps spatially incomplete observations to a model state with full spatial coverage and resolution. The CAE was applied to an incomplete streamfunction observation (similar to 30% missing) from a high-resolution benchmark simulation and demonstrated satisfactory reconstruction performance, even when only very sparse (1/16 of T63 grid density) observations were used as input. When only spatially incomplete observations are used, the analysis fields obtained from ensemble square root filter (EnSRF) assimilation exhibit significant error. However, in DDA, when EnSRF takes in the combined data from the incomplete observations and CAE reconstruction, analysis error reduces significantly. Such gains are more pronounced with sparse observation and small ensemble size because the DDA analysis is much less sensitive to observation density and ensemble size than the conventional DA analysis, which is based solely on incomplete observations. Significance StatementData assimilation plays a critical role in improving the skills of modern numerical weather prediction by establishing accurate initial conditions. However, unobservable regions are common in observation data, particularly those derived from remote sensing. The nonlinear relationship between data from observable regions and the physical state of unobservable regions may impede DA efficiency. As a result, we propose that deep learning be used to improve data assimilation in such cases by reconstructing a spatially complete first guess of the physical state with deep learning and then applying data assimilation to the reconstructed field. Such deep learning augmentation is found effective in improving the accuracy of data assimilation, especially for sparse observation and small ensemble size.

High-Fidelity Deep Approximation of Ecosystem Simulation over Long-Term at Large Scale.

DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolution

Efficient surrogate modeling methods for large-scale Earth system models based on machine learning techniques

Distributed Hydrological Modeling With Physics‐Encoded Deep Learning: A General Framework and Its Application in the Amazon

Partitioning Eddy Covariance CO2 Fluxes into Ecosystem Respiration and Gross Primary Productivity Through a New Hybrid Four Sub-Deep Neural Network

Projecting Australia's Forest Cover Dynamics and Exploring Influential Factors Using Deep Learning.

A non-intrusive machine learning framework for debiasing long-time coarse resolution climate simulations and quantifying rare events statistics

Opportunistic Emulation of Computationally Expensive Simulations via Deep Learning

Bridging Hydrological Ensemble Simulation and Learning Using Deep Neural Operators

A Hybrid Deep Learning Framework with Physical Process Description for Simulation of Evapotranspiration

Dynamical-generative downscaling of climate model ensembles

A Non‐Intrusive Machine Learning Framework for Debiasing Long‐Time Coarse Resolution Climate Simulations and Quantifying Rare Events Statistics

Iterative Integration of Deep Learning in Hybrid Earth Surface System Modelling

Hd-Deep-EM: Deep Expectation Maximization for Dynamic Hidden State Recovery Using Heterogeneous Data

Global Evaluation of the Ecosystem Demography Model (ED V3.0)

Repeatable high-resolution statistical downscaling through deep learning

An Online Deep Convolutional Model of Gross Primary Productivity and Net Ecosystem Exchange Estimation for Global Forests

Spatio-temporal Simulation and Prediction of Regional Ecological Security Based on Deep Learning

Global Evaluation of the Ecosystem Demography Model ( ED 1 v 3 . 0 ) 2 3

Spatiotemporal estimation of groundwater and surface water conditions by integrating deep learning and physics-based watershed models

Deep Learning Augmented Data Assimilation: Reconstructing Missing Information with Convolutional Autoencoders