Abstract:This work presents a hybrid modeling approach to data-driven learning and representation of unknown physical processes and closure parameterizations. These hybrid models are suitable for situations where the mechanistic description of dynamics of some variables is unknown, but reasonably accurate observational data can be obtained for the evolution of the state of the system. In this work, we propose machine learning to account for missing physics and then data assimilation to correct the prediction. In particular, we devise an effective methodology based on a recurrent neural network to model the unknown dynamics. A long short-term memory (LSTM) based correction term is added to the predictive model in order to take into account hidden physics. Since LSTM introduces a black-box approach for the unknown part of the model, we investigate whether the proposed hybrid neural-physical model can be further corrected through a sequential data assimilation step. We apply this framework to the weakly nonlinear Lorenz model that displays quasiperiodic oscillations, the highly nonlinear Lorenz model, and two-scale Lorenz model. The hybrid neural-physics model yields accurate results for the weakly nonlinear Lorenz model with the predicted state close to the true Lorenz model trajectory. For the highly nonlinear Lorenz model and the two-scale Lorenz model, the hybrid neural-physics model deviates from the true state due to the accumulation of prediction error from one time step to the next time step. The ensemble Kalman filter approach takes into account the prediction error and updates the diverged prediction using available observations in order to provide a more accurate state estimate. The successful synergistic integration of neural network and data assimilation for low-dimensional system shows the potential benefits of the proposed hybrid-neural physics model for complex systems.

Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations

Physics-informed learning of governing equations from scarce data

Physics-Based Deep Learning for Flow Problems

Nonlinear Schrödinger Network

Deep-learning of parametric partial differential equations from sparse and noisy data

Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equations

Physics guided neural networks for modelling of non-linear dynamics

Solving Partial Differential Equations Using Deep Learning and Physical Constraints

A Deep Learning Approach for Predicting Spatiotemporal Dynamics From Sparsely Observed Data

A Deep Learning Framework for Solving Hyperbolic Partial Differential Equations: Part I

DL-PDE: Deep-learning based data-driven discovery of partial differential equations from discrete and noisy data

Multi-level Physics Informed Deep Learning for Solving Partial Differential Equations in Computational Structural Mechanics

Learning Hidden Physics and System Parameters with Deep Operator Networks

An Analysis of Physics-Informed Neural Networks

Physics Constrained Learning for Data-driven Inverse Modeling from Sparse Observations

Spatio-Temporal Super-Resolution of Dynamical Systems using Physics-Informed Deep-Learning

A nonintrusive hybrid neural-physics modeling of incomplete dynamical systems: Lorenz equations

Integrating Physics-Informed Deep Learning and Numerical Methods for Robust Dynamics Discovery and Parameter Estimation