Abstract:Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging gain matrix might be cumbersome. In this paper, we put forth a fully nonintrusive recurrent neural network approach based on a long short-term memory (LSTM) embedding architecture to estimate the nudging term, which plays a role not only to force the state trajectories to the observations but also acts as a stabilizer. Furthermore, our approach relies on the power of archival data and the trained model can be retrained effectively due to power of transfer learning in any neural network applications. In order to verify the feasibility of the proposed approach, we perform twin experiments using Lorenz 96 system. Our results demonstrate that the proposed LSTM nudging approach yields more accurate estimates than both extended Kalman filter (EKF) and ensemble Kalman filter (EnKF) when only sparse observations are available. With the availability of emerging AI-friendly and modular hardware technologies and heterogeneous computing platforms, we articulate that our simplistic nudging framework turns out to be computationally more efficient than either the EKF or EnKF approaches.

On the Infinite-Nudging Limit of the Nudging Filter for Continuous Data Assimilation

Determining Modes, Synchronization, and Intertwinement

Super-exponential convergence rate of a nonlinear continuous data assimilation algorithm: The 2D Navier-Stokes equations paradigm

Super-Exponential Convergence Rate of a Nonlinear Continuous Data Assimilation Algorithm: The 2D Navier–Stokes Equation Paradigm

Analysis of continuous data assimilation with large (or even infinite) nudging parameters

A Hybrid Nudging-Ensemble Kalman Filter Approach to Data Assimilation. Part Ii: Application in A Shallow-Water Model

A Hybrid Nudging-Ensemble Kalman Filter Approach to Data Assimilation. Part I: Application in the Lorenz System

A Computational Study of a Data Assimilation Algorithm for the Two-dimensional Navier--Stokes Equations

On the inadequacy of nudging data assimilation algorithms for non-dissipative systems: A computational examination of the Korteweg de-Vries and Lorenz equations

Continuous Data Assimilation Algorithm for the Two Dimensional Cahn–Hilliard–Navier–Stokes System

Enhancing nonlinear solvers for the Navier–Stokes equations with continuous (noisy) data assimilation

Accelerating and enabling convergence of nonlinear solvers for Navier-Stokes equations by continuous data assimilation

Enhancing nonlinear solvers for the Navier-Stokes equations with continuous (noisy) data assimilation

Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows

Adaptive Parameter Selection in Nudging Based Data Assimilation

An Approach for Filter Divergence Suppression in a Sequential Data Assimilation System and Its Application in Short-Term Traffic Flow Forecasting

Synchronizing large eddy simulations with direct numerical simulations via data assimilation

Nudging state-space models for Bayesian filtering under misspecified dynamics

Continuous Data Assimilation for the 3D and Higher-Dimensional Navier--Stokes equations with Higher-Order Fractional Diffusion

Continuous data assimilation for hydrodynamics: consistent discretization and application to moment recovery

Data assimilation for the stochastic Camassa-Holm equation using particle filtering: a numerical investigation