Abstract:Understanding real-world dynamical phenomena remains a challenging task. Across various scientific disciplines, machine learning has advanced as the go-to technology to analyze nonlinear dynamical systems, identify patterns in big data, and make decision around them. Neural networks are now consistently used as universal function approximators for data with underlying mechanisms that are incompletely understood or exceedingly complex. However, neural networks alone ignore the fundamental laws of physics and often fail to make plausible predictions. Here we integrate data, physics, and uncertainties by combining neural networks, physics-informed modeling, and Bayesian inference to improve the predictive potential of traditional neural network models. We embed the physical model of a damped harmonic oscillator into a fully-connected feed-forward neural network to explore a simple and illustrative model system, the outbreak dynamics of COVID-19. Our Physics-Informed Neural Networks can seamlessly integrate data and physics, robustly solve forward and inverse problems, and perform well for both interpolation and extrapolation, even for a small amount of noisy and incomplete data. At only minor additional cost, they can self-adaptively learn the weighting between data and physics. Combined with Bayesian Neural Networks, they can serve as priors in a Bayesian Inference, and provide credible intervals for uncertainty quantification. Our study reveals the inherent advantages and disadvantages of Neural Networks, Bayesian Inference, and a combination of both and provides valuable guidelines for model selection. While we have only demonstrated these approaches for the simple model problem of a seasonal endemic infectious disease, we anticipate that the underlying concepts and trends generalize to more complex disease conditions and, more broadly, to a wide variety of nonlinear dynamical systems.

Design of Neuro-Stochastic Bayesian Networks for Nonlinear Chaotic Differential Systems in Financial Mathematics

Novel intelligent supervised neuro-structures for nonlinear financial crime differential systems

Neural network stochastic differential equation models with applications to financial data forecasting

Probabilistic solution of chaotic dynamical system inverse problems using Bayesian Artificial Neural Networks

Learning Solutions of Stochastic Optimization Problems with Bayesian Neural Networks

Robust financial calibration: a Bayesian approach for neural SDEs

Convergence Enhancement for Neural Network Integrated Power System Time Domain Simulation

Numerically Unveiling Hidden Chaotic Dynamics in Nonlinear Differential Equations with Riemann-Liouville, Caputo-Fabrizio, and Atangana-Baleanu Fractional Derivatives

Neural network as a simulation metamodel in economic analysis of risky projects

Dealing with Stochasticity in Biological ODE Models

Neural network-based finite horizon stochastic optimal control design for nonlinear networked control systems

Bayesian Neural Ordinary Differential Equations

Modeling and Forecasting of the Nonlinear Dynamic System Neural Network Based on the Chaotic Time Series

Dynamic dependence networks: Financial time series forecasting and portfolio decisions (with discussion)

Studying a Chaotic Spiking Neural Model

Safety Guarantees for Neural Network Dynamic Systems via Stochastic Barrier Functions

Machine Learning Methods for Pricing Financial Derivatives

Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systems

Predicting Chaotic Time Series Using Neural and Neurofuzzy Models: A Comparative Study

Neural networks-based algorithms for stochastic control and PDEs in finance

Modeling and Decision-making of Financial Time Series Data with DBN