Abstract:Understanding real-world dynamical phenomena remains a challenging task. Across various scientific disciplines, machine learning has advanced as the go-to technology to analyze nonlinear dynamical systems, identify patterns in big data, and make decision around them. Neural networks are now consistently used as universal function approximators for data with underlying mechanisms that are incompletely understood or exceedingly complex. However, neural networks alone ignore the fundamental laws of physics and often fail to make plausible predictions. Here we integrate data, physics, and uncertainties by combining neural networks, physics-informed modeling, and Bayesian inference to improve the predictive potential of traditional neural network models. We embed the physical model of a damped harmonic oscillator into a fully-connected feed-forward neural network to explore a simple and illustrative model system, the outbreak dynamics of COVID-19. Our Physics-Informed Neural Networks can seamlessly integrate data and physics, robustly solve forward and inverse problems, and perform well for both interpolation and extrapolation, even for a small amount of noisy and incomplete data. At only minor additional cost, they can self-adaptively learn the weighting between data and physics. Combined with Bayesian Neural Networks, they can serve as priors in a Bayesian Inference, and provide credible intervals for uncertainty quantification. Our study reveals the inherent advantages and disadvantages of Neural Networks, Bayesian Inference, and a combination of both and provides valuable guidelines for model selection. While we have only demonstrated these approaches for the simple model problem of a seasonal endemic infectious disease, we anticipate that the underlying concepts and trends generalize to more complex disease conditions and, more broadly, to a wide variety of nonlinear dynamical systems.

Physics-informed nonlinear vector autoregressive models for the prediction of dynamical systems

Physics guided neural networks for modelling of non-linear dynamics

Nonlinear Schrödinger Network

Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systems

Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations

Beyond Predictions in Neural ODEs: Identification and Interventions.

A nonintrusive hybrid neural-physics modeling of incomplete dynamical systems: Lorenz equations

Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations

Invariant Physics-Informed Neural Networks for Ordinary Differential Equations

Forecasting of Nonlinear Dynamics Based on Symbolic Invariance

Solving Nonlinear Energy Supply and Demand System Using Physics-Informed Neural Networks

Physics-informed recurrent neural network modeling for predictive control of nonlinear processes

Physics-informed learning of governing equations from scarce data

Physics-informed neural ODE (PINODE): embedding physics into models using collocation points

Parameter estimation and modeling of nonlinear dynamical systems based on Runge–Kutta physics-informed neural network

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

Physics-informed Autoencoders for Lyapunov-stable Fluid Flow Prediction

Neural modal ordinary differential equations: Integrating physics-based modeling with neural ordinary differential equations for modeling high-dimensional monitored structures

Response Estimation and System Identification of Dynamical Systems via Physics-Informed Neural Networks

Enhancing Accuracy of Physically Informed Neural Networks for Nonlinear Schrödinger Equations Through Multi-View Transfer Learning