Abstract:Nonlinear dynamics are ubiquitous in science and engineering applications, but the physics of most complex systems is far from being fully understood. Discovering interpretable governing equations from measurement data can help us understand and predict the behavior of complex dynamic systems. Although extensive work has recently been done in this field, robustly distilling explicit model forms from very sparse data with considerable noise remains intractable. Moreover, quantifying and propagating the uncertainty of the identified system from noisy data is challenging, and relevant literature is still limited. To bridge this gap, we develop a novel Bayesian spline learning framework to identify parsimonious governing equations of nonlinear (spatio)temporal dynamics from sparse, noisy data with quantified uncertainty. The proposed method utilizes spline basis to handle the data scarcity and measurement noise, upon which a group of derivatives can be accurately computed to form a library of candidate model terms. The equation residuals are used to inform the spline learning in a Bayesian manner, where approximate Bayesian uncertainty calibration techniques are employed to approximate posterior distributions of the trainable parameters. To promote the sparsity, an iterative sequential-threshold Bayesian learning approach is developed, using the alternative direction optimization strategy to systematically approximate L0 sparsity constraints. The proposed algorithm is evaluated on multiple nonlinear dynamical systems governed by canonical ordinary and partial differential equations, and the merit/superiority of the proposed method is demonstrated by comparison with state-of-the-art methods.

Machine Discovery of Partial Differential Equations from Spatiotemporal Data: A Sparse Bayesian Learning Framework.

Bayesian data-driven discovery of partial differential equations with variable coefficients

Data-driven discovery of stochastic differential equations

Discovering stochastic partial differential equations from limited data using variational Bayes inference

A Deep Learning Approach for Predicting Spatiotemporal Dynamics From Sparsely Observed Data

Sparse inference and active learning of stochastic differential equations from data

Deep-learning based discovery of partial differential equations in integral form from sparse and noisy data

Sparse learning of partial differential equations with structured dictionary matrix.

Automatically discovering ordinary differential equations from data with sparse regression

DL-PDE: Deep-learning based data-driven discovery of partial differential equations from discrete and noisy data

Linking Machine Learning with Multiscale Numerics: Data-Driven Discovery of Homogenized Equations

Deep-learning of parametric partial differential equations from sparse and noisy data

Discovery of differential equations using sparse state and parameter regression

Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics with Quantified Uncertainty

Physics-informed learning of governing equations from scarce data

Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learning

Physics-informed genetic programming for discovery of partial differential equations from scarce and noisy data

Learning unbounded-domain spatiotemporal differential equations using adaptive spectral methods

Promising directions of machine learning for partial differential equations

Physics-Guided Discovery of Highly Nonlinear Parametric Partial Differential Equations

The SPDE approach for spatio-temporal datasets with advection and diffusion