Abstract:Parameter estimation is one of the central problems in computational modeling of biological systems. Typically, scientists must fully specify the mathematical structure of the model, often expressed as a system of ordinary differential equations, to estimate the parameters. This process poses significant challenges due to the necessity for a detailed understanding of the underlying biological mechanisms. In this paper, we present an approach for estimating model parameters and assessing their identifiability in situations where only partial knowledge of the system structure is available. The partially known model is extended into a system of Hybrid Neural Ordinary Differential Equations, which captures the unknown portions of the system using neural networks. Integrating neural networks into the model structure introduces two primary challenges for parameter estimation: the need to globally explore the search space while employing gradient-based optimization, and the assessment of parameter identifiability, which may be hindered by the expressive nature of neural networks. To overcome the first issue, we treat biological parameters as hyperparameters in the extended model, exploring the parameter search space during hyperparameter tuning. The second issue is then addressed by an a posteriori analysis of parameter identifiability, computed by introducing a variant of a well-established approach for mechanistic models. These two components are integrated into an end-to-end pipeline that is thoroughly described in the paper. We assess the effectiveness of the proposed workflow on test cases derived from three different benchmark models. These test cases have been designed to mimic real-world conditions, including the presence of noise in the training data and various levels of data availability for the system variables.

Local Parameter Identification with Neural Ordinary Differential Equations

Robust parameter estimation and identifiability analysis with Hybrid Neural Ordinary Differential Equations in Computational Biology

A Novel Data-Driven Model Based Parameter Estimation of Nonlinear Systems

NeuralSI: Structural Parameter Identification in Nonlinear Dynamical Systems

Systems Biology: Identifiability analysis and parameter identification via systems-biology informed neural networks

Parameter Inversion Method for Detecting Damage of Structure with Input Completely Unknown

On Model-guided Neural Networks for System Identification

Nonlinear Ode Parameter Identification of Electro-Hydraulic Servo System Based on Trust-Region Optimization Algorithm

Parameter Identification of Dynamical Systems Based on Short-Term Prediction by the Generalized Cell Mapping Method with Deep Learning

Calibrating multi-dimensional complex ODE from noisy data via deep neural networks

A Parameter Estimation Method for Biological Systems Modelled by ODE/DDE Models Using Spline Approximation and Differential Evolution Algorithm

Machine learning in parameter estimation of nonlinear systems

Parameter Identification for Partial Differential Equations with Spatiotemporal Varying Coefficients

Neural Network Parameter Identification of Electro-hydraulic Load Simulator

Numerical Method for Parameter Inference of Systems of Nonlinear Ordinary Differential Equations with Partial Observations.

Complex Nonlinear System Modelling and Parameters Identification by Deep Neural Networks

Joint State and Parameter Estimation of Nonlinear Dynamical Systems Through Alternating Optimization

A model reference adaptive system approach for nonlinear online parameter identification

Data-driven modeling and parameter estimation of Nonlinear systems

Neural Ordinary Differential Equations for Nonlinear System Identification

Data-driven Identification of Parametric Governing Equations of Dynamical Systems Using the Signed Cumulative Distribution Transform