Abstract:Due to the high complexity of biological data it is difficult to disentangle cellular processes relying only on intuitive interpretation of measurements. A Systems Biology approach that combines quantitative experimental data with dynamic mathematical modeling promises to yield deeper insights into these processes. Nevertheless, with growing complexity and increasing amount of quantitative experimental data, building realistic and reliable mathematical models can become a challenging task: the quality of experimental data has to be assessed objectively, unknown model parameters need to be estimated from the experimental data, and numerical calculations need to be precise and efficient. Here, we discuss, compare and characterize the performance of computational methods throughout the process of quantitative dynamic modeling using two previously established examples, for which quantitative, dose- and time-resolved experimental data are available. In particular, we present an approach that allows to determine the quality of experimental data in an efficient, objective and automated manner. Using this approach data generated by different measurement techniques and even in single replicates can be reliably used for mathematical modeling. For the estimation of unknown model parameters, the performance of different optimization algorithms was compared systematically. Our results show that deterministic derivative-based optimization employing the sensitivity equations in combination with a multi-start strategy based on latin hypercube sampling outperforms the other methods by orders of magnitude in accuracy and speed. Finally, we investigated transformations that yield a more efficient parameterization of the model and therefore lead to a further enhancement in optimization performance. We provide a freely available open source software package that implements the algorithms and examples compared here.

Universal differential equations for systems biology: Current state and open problems

Non-Negative Universal Differential Equations With Applications in Systems Biology

Universal Differential Equations as a Common Modeling Language for Neuroscience

Physiology-informed regularization enables training of universal differential equation systems for biological applications

An analysis of Universal Differential Equations for data-driven discovery of Ordinary Differential Equations

Assessment of Uncertainty Quantification in Universal Differential Equations

Optimal Experimental Design for Universal Differential Equations

Lessons Learned from Quantitative Dynamical Modeling in Systems Biology

Data2Dynamics: a Modeling Environment Tailored to Parameter Estimation in Dynamical Systems.

Learning COVID-19 Regional Transmission Using Universal Differential Equations in a SIR model

Uncertainty Quantification in Neural Differential Equations

Bayesian Neural Ordinary Differential Equations

On Neural Differential Equations

Identifying Latent Dynamic Components in Biological Systems

A comparative study of NeuralODE and Universal ODE approaches to solving Chandrasekhar White Dwarf equation

Hybrid Neural Differential Equations to Model Unknown Mechanisms and States in Biology

Systems Biology: Identifiability analysis and parameter identification via systems-biology informed neural networks

Dealing with Stochasticity in Biological ODE Models

Uncertainty and Structure in Neural Ordinary Differential Equations

Neural Differential Algebraic Equations

A Survey on Solving and Discovering Differential Equations Using Deep Neural Networks