Abstract:Due to the high complexity of biological data it is difficult to disentangle cellular processes relying only on intuitive interpretation of measurements. A Systems Biology approach that combines quantitative experimental data with dynamic mathematical modeling promises to yield deeper insights into these processes. Nevertheless, with growing complexity and increasing amount of quantitative experimental data, building realistic and reliable mathematical models can become a challenging task: the quality of experimental data has to be assessed objectively, unknown model parameters need to be estimated from the experimental data, and numerical calculations need to be precise and efficient. Here, we discuss, compare and characterize the performance of computational methods throughout the process of quantitative dynamic modeling using two previously established examples, for which quantitative, dose- and time-resolved experimental data are available. In particular, we present an approach that allows to determine the quality of experimental data in an efficient, objective and automated manner. Using this approach data generated by different measurement techniques and even in single replicates can be reliably used for mathematical modeling. For the estimation of unknown model parameters, the performance of different optimization algorithms was compared systematically. Our results show that deterministic derivative-based optimization employing the sensitivity equations in combination with a multi-start strategy based on latin hypercube sampling outperforms the other methods by orders of magnitude in accuracy and speed. Finally, we investigated transformations that yield a more efficient parameterization of the model and therefore lead to a further enhancement in optimization performance. We provide a freely available open source software package that implements the algorithms and examples compared here.

Partial observations and conservation laws: Grey-box modeling in biotechnology and optogenetics

Partial observation can induce mechanistic mismatches in data-constrained models of neural dynamics

Some of the variables, some of the parameters, some of the times, with some physics known: Identification with partial information

Lessons Learned from Quantitative Dynamical Modeling in Systems Biology

Data-Driven Modeling of Partially Observed Biological Systems

A nonintrusive hybrid neural-physics modeling of incomplete dynamical systems: Lorenz equations

Data-driven and Physics Informed Modelling of Chinese Hamster Ovary Cell Bioreactors

Biological conservation law as an emerging functionality in dynamical neuronal networks

Physics-Informed Neural State Space Models via Learning and Evolution

A system identification analysis of optogenetically evoked electrocorticography and cerebral blood flow responses

Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations

Discovering dynamics and parameters of nonlinear oscillatory and chaotic systems from partial observations

An in-silico framework for modeling optimal control of neural systems

How to Re-enable PDE Loss for Physical Systems Modeling Under Partial Observation

Characterization of Biologically Relevant Network Structures form Time-series Data

Biologically-informed neural networks guide mechanistic modeling from sparse experimental data

A Hybrid Simulation of DNN-based Gray Box Models

Bi-fidelity Modeling of Uncertain and Partially Unknown Systems using DeepONets

Hybrid physics-informed metabolic cybergenetics: process rates augmented with machine-learning surrogates informed by flux balance analysis

Probabilistic models, compressible interactions, and neural coding