Abstract:This paper proposes a new method to identify nonlinear state-space systems from heterogeneous datasets. The method is described in the context of identifying biochemical/gene networks (i.e., identifying both reaction dynamics and kinetic parameters) from experimental data. Simultaneous integration of various datasets has the potential to yield better performance for system identification. Data collected experimentally typically vary depending on the specific experimental setup and conditions. Typically, heterogeneous data are obtained experimentally through 1) replicate measurements from the same biological system or 2) application of different experimental conditions such as changes/perturbations in biological inductions, temperature, gene knock-out, gene over-expression, etc. We formulate here the identification problem using a Bayesian learning framework that makes use of “sparse group” priors to allow inference of the sparsest model that can explain the whole set of observed heterogeneous data. To enable scale up to large number of features, the resulting nonconvex optimization problem is relaxed to a reweighted Group Lasso problem using a convex–concave procedure. As an illustrative example of the effectiveness of our method, we use it to identify a genetic oscillator (generalized eight species repressilator). Through this example we show that our algorithm outperforms Group Lasso when the number of experiments is increased, even when each single time-series dataset is short. We additionally assess the robustness of our algorithm against noise by varying the intensity of process noise and measurement noise.

An L-BFGS-B approach for linear and nonlinear system identification under $\ell_1$- and group-Lasso regularization

l0 Norm Constraint LMS Algorithm for Sparse System Identification.

Identification of Analytic Nonlinear Dynamical Systems with Non-asymptotic Guarantees

Identification of Nonlinear State-Space Systems from Heterogeneous Datasets

Online system identification under non-negativity and ℓ1-norm constraints algorithm and weight behavior analysis

System identification under non-negativity constraints

$L_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification

Stable Linear Subspace Identification: A Machine Learning Approach

Partially-Linear Least-Squares Regularized Regression for System Identification

A Sparse Bayesian Approach to the Identification of Nonlinear State-Space Systems.

Sparse LMS for System Identification

Group Sparse Lms For Multiple System Identification

Sparse Identification of Dynamical Systems by Reweighted l1 -regularized Least Absolute Deviation Regression

L∞ parameter identification based on linear programming recursive algorithm

Combined Learning of Linear Parameter-Varying Models and Robust Control Invariant Sets

Error Gradient-based Variable-Lp Norm Constraint LMS Algorithm for Sparse System Identification

Variational Identification of Linearly Parameterized Nonlinear State-Space Systems

A Local Sparse Screening Identification Algorithm with Applications

Regularized Least-Mean-Square Algorithms

Regularized Least Absolute Deviation-Based Sparse Identification of Dynamical Systems.

Parameter Identification for Nonlinear State-Space Models of A Biological Network Via Linearization and Robust State Estimation