Abstract:Nonlinear dynamics are ubiquitous in science and engineering applications, but the physics of most complex systems is far from being fully understood. Discovering interpretable governing equations from measurement data can help us understand and predict the behavior of complex dynamic systems. Although extensive work has recently been done in this field, robustly distilling explicit model forms from very sparse data with considerable noise remains intractable. Moreover, quantifying and propagating the uncertainty of the identified system from noisy data is challenging, and relevant literature is still limited. To bridge this gap, we develop a novel Bayesian spline learning framework to identify parsimonious governing equations of nonlinear (spatio)temporal dynamics from sparse, noisy data with quantified uncertainty. The proposed method utilizes spline basis to handle the data scarcity and measurement noise, upon which a group of derivatives can be accurately computed to form a library of candidate model terms. The equation residuals are used to inform the spline learning in a Bayesian manner, where approximate Bayesian uncertainty calibration techniques are employed to approximate posterior distributions of the trainable parameters. To promote the sparsity, an iterative sequential-threshold Bayesian learning approach is developed, using the alternative direction optimization strategy to systematically approximate L0 sparsity constraints. The proposed algorithm is evaluated on multiple nonlinear dynamical systems governed by canonical ordinary and partial differential equations, and the merit/superiority of the proposed method is demonstrated by comparison with state-of-the-art methods.

Adaptive Bayesian Multivariate Spline Knot Inference with Prior Specifications on Model Complexity

Adaptive Priors based on Splines with Random Knots

Estimation of Knots in Linear Spline Models

Spline regression with automatic knot selection

Exact Penalty Method for Knot Selection of B-Spline Regression

On Bayesian Curve Fitting via Auxiliary Variables

Knot Calculation for Spline Fitting Via Sparse Optimization

Synergizing Roughness Penalization and Basis Selection in Bayesian Spline Regression

On Knot Placement for Penalized Spline Regression

Mapping-to-Parameter Nonlinear Functional Regression with Novel B-spline Free Knot Placement Algorithm

Adaptive Nonparametric Density Estimation with B-Spline Bases

Variational Bayesian Lasso for spline regression

Knot Selection of Estimating the Term Structure with Cubit Spline Function

Multivariate Lévy Adaptive B-Spline Regression

B-spline surface fitting by iterative geometric interpolation/approximation algorithms

Bayesian estimation for longitudinal data in a joint model with HPCs

Approximate merging of B-spline curves via knot adjustment and constrained optimization

SplineGen: Approximating Unorganized Points Through Generative AI

Efficient and fast spline-backfitted kernel smoothing of additive models

Knot adjustment of B-Spline curves

Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics with Quantified Uncertainty