Abstract:The quantitative formulation of evolution equations is the backbone for prediction, control, and understanding of dynamical systems across diverse scientific fields. Besides deriving differential equations for dynamical systems based on basic scientific reasoning or prior knowledge in recent times a growing interest emerged to infer these equations purely from data. In this article, we introduce a novel method for the sparse identification of nonlinear dynamical systems from observational data, based on the observation how the key challenges of the quality of time derivatives and sampling rates influence this problem. Our approach combines system identification based on thresholded least squares minimization with additional error measures that account for both the deviation between the model and the time derivative of the data, and the integrated performance of the model in forecasting dynamics. Specifically, we integrate a least squares error as well as the Wasserstein metric for estimated models and combine them within a Bayesian optimization framework to efficiently determine optimal hyperparameters for thresholding and weighting of the different error norms. Additionally, we employ distinct regularization parameters for each differential equation in the system, enhancing the method's precision and flexibility. We demonstrate the capabilities of our approach through applications to dynamical fMRI data and the prototypical example of a wake flow behind a cylinder. In the wake flow problem, our method identifies a sparse, accurate model that correctly captures transient dynamics, oscillation periods, and phase information, outperforming existing methods. In the fMRI example, we show how our approach extracts insights from a trained recurrent neural network, offering a novel avenue for explainable AI by inferring differential equations that capture potentially causal relationships.

Sparse identification of evolution equations via Bayesian model selection

Automatically discovering ordinary differential equations from data with sparse regression

Bayesian Model Selection Methods and Their Application to Biological ODE Systems

Automatically identifying ordinary differential equations from data

A Bayesian Approach for Data-Driven Dynamic Equation Discovery

Rapid Bayesian identification of sparse nonlinear dynamics from scarce and noisy data

Model selection of chaotic systems from data with hidden variables using sparse data assimilation

Discovering governing equations from data: Sparse identification of nonlinear dynamical systems

Model selection for hybrid dynamical systems via sparse regression

Statistical Mechanics of Dynamical System Identification

Discovery of differential equations using sparse state and parameter regression

Sparse inference and active learning of stochastic differential equations from data

Discovering governing equations from data by sparse identification of nonlinear dynamical systems

Identifying Latent Dynamic Components in Biological Systems

Dynamical Modeling for Non-Gaussian Data with High-Dimensional Sparse Ordinary Differential Equations

Deep Generative Modeling for Identification of Noisy, Non-Stationary Dynamical Systems

Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics with Quantified Uncertainty

Evolutionary sparse data-driven discovery of multibody system dynamics

Discovering Sparse Interpretable Dynamics from Partial Observations

Physics-informed AI and ML-based sparse system identification algorithm for discovery of PDE's representing nonlinear dynamic systems

An evolutionary approach for discovering non-Gaussian stochastic dynamical systems based on nonlocal Kramers-Moyal formulas