Abstract:Understanding real-world dynamical phenomena remains a challenging task. Across various scientific disciplines, machine learning has advanced as the go-to technology to analyze nonlinear dynamical systems, identify patterns in big data, and make decision around them. Neural networks are now consistently used as universal function approximators for data with underlying mechanisms that are incompletely understood or exceedingly complex. However, neural networks alone ignore the fundamental laws of physics and often fail to make plausible predictions. Here we integrate data, physics, and uncertainties by combining neural networks, physics-informed modeling, and Bayesian inference to improve the predictive potential of traditional neural network models. We embed the physical model of a damped harmonic oscillator into a fully-connected feed-forward neural network to explore a simple and illustrative model system, the outbreak dynamics of COVID-19. Our Physics-Informed Neural Networks can seamlessly integrate data and physics, robustly solve forward and inverse problems, and perform well for both interpolation and extrapolation, even for a small amount of noisy and incomplete data. At only minor additional cost, they can self-adaptively learn the weighting between data and physics. Combined with Bayesian Neural Networks, they can serve as priors in a Bayesian Inference, and provide credible intervals for uncertainty quantification. Our study reveals the inherent advantages and disadvantages of Neural Networks, Bayesian Inference, and a combination of both and provides valuable guidelines for model selection. While we have only demonstrated these approaches for the simple model problem of a seasonal endemic infectious disease, we anticipate that the underlying concepts and trends generalize to more complex disease conditions and, more broadly, to a wide variety of nonlinear dynamical systems.

Equivariant Neural Simulators for Stochastic Spatiotemporal Dynamics

Neural Network Emulation of Spatio-temporal Data Using Linear and Nonlinear Dimensionality Reduction

Equivariant Spatio-Temporal Attentive Graph Networks to Simulate Physical Dynamics

Stochastic Neural Simulator for Generalizing Dynamical Systems Across Environments

Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations

Augmenting Differentiable Simulators with Neural Networks to Close the Sim2Real Gap

Towards Learned Simulators for Cell Migration

Integration of Continuous-Time Dynamics in a Spiking Neural Network Simulator

Approximately Equivariant Neural Processes

Modeling Randomly Observed Spatiotemporal Dynamical Systems

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning.

Space-Time Continuous PDE Forecasting using Equivariant Neural Fields

Stochastic physics-informed neural ordinary differential equations

Data-driven spatiotemporal modeling for structural dynamics on irregular domains by stochastic dependency neural estimation

Neural Operators for Accelerating Scientific Simulations and Design

Neural stochastic Volterra equations: learning path-dependent dynamics

Probabilistic Surrogate Networks for Simulators with Unbounded Randomness

On instabilities in neural network-based physics simulators

Learning effective stochastic differential equations from microscopic simulations: combining stochastic numerics and deep learning

Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systems

Neural field simulator: two-dimensional spatio-temporal dynamics involving finite transmission speed