Abstract:Due to the high complexity of biological data it is difficult to disentangle cellular processes relying only on intuitive interpretation of measurements. A Systems Biology approach that combines quantitative experimental data with dynamic mathematical modeling promises to yield deeper insights into these processes. Nevertheless, with growing complexity and increasing amount of quantitative experimental data, building realistic and reliable mathematical models can become a challenging task: the quality of experimental data has to be assessed objectively, unknown model parameters need to be estimated from the experimental data, and numerical calculations need to be precise and efficient. Here, we discuss, compare and characterize the performance of computational methods throughout the process of quantitative dynamic modeling using two previously established examples, for which quantitative, dose- and time-resolved experimental data are available. In particular, we present an approach that allows to determine the quality of experimental data in an efficient, objective and automated manner. Using this approach data generated by different measurement techniques and even in single replicates can be reliably used for mathematical modeling. For the estimation of unknown model parameters, the performance of different optimization algorithms was compared systematically. Our results show that deterministic derivative-based optimization employing the sensitivity equations in combination with a multi-start strategy based on latin hypercube sampling outperforms the other methods by orders of magnitude in accuracy and speed. Finally, we investigated transformations that yield a more efficient parameterization of the model and therefore lead to a further enhancement in optimization performance. We provide a freely available open source software package that implements the algorithms and examples compared here.

Neural Ordinary Differential Equations Inspired Parameterization of Kinetic Models

Scalable Parameter Estimation for Genome-Scale Biochemical Reaction Networks

Data2Dynamics: a Modeling Environment Tailored to Parameter Estimation in Dynamical Systems.

Bayesian Parameter Estimation for Biochemical Reaction Networks Using Region-Based Adaptive Parallel Tempering

SBMLtoODEjax: Efficient Simulation and Optimization of Biological Network Models in JAX

Kinetics Parameter Optimization via Neural Ordinary Differential Equations

Embedding Physics into Neural ODEs to learn Kinetics from Integral Reactors

Differentiable simulation enables large-scale training of detailed biophysical models of neural dynamics

Lessons Learned from Quantitative Dynamical Modeling in Systems Biology

Deep Learning for Fast Inference of Mechanistic Models' Parameters

Predicting time-varying flux and balance in metabolic systems using structured neural-ODE processes

Bayesian Neural Ordinary Differential Equations

Building kinetic models for metabolic engineering

Robust parameter estimation and identifiability analysis with Hybrid Neural Ordinary Differential Equations in Computational Biology

Kinetics parameter optimization of hydrocarbon fuels via neural ordinary differential equations

Learning kinetics from non-ideal reactors by implicitly solved finite volumes and global reaction neural networks

Physics-Enhanced Neural Ordinary Differential Equations: Application to Industrial Chemical Reaction Systems

Identification of Parameters for Large-scale Kinetic Models

Efficient Amortised Bayesian Inference for Hierarchical and Nonlinear Dynamical Systems

Model Order Reduction for the 1D Boltzmann-BGK Equation: Identifying Intrinsic Variables Using Neural Networks

Towards kinetic modeling of metabolic networks with incomplete parameters