Abstract:Background Ordinary differential equation (ODE) models are widely used to describe (bio-)chemical and biological processes. To enhance the predictive power of these models, their unknown parameters are estimated from experimental data. These experimental data are mostly collected in perturbation experiments, in which the processes are pushed out of steady state by applying a stimulus. The information that the initial condition is a steady state of the unperturbed process provides valuable information, as it restricts the dynamics of the process and thereby the parameters. However, implementing steady-state constraints in the optimization often results in convergence problems. Results In this manuscript, we propose two new methods for solving optimization problems with steady-state constraints. The first method exploits ideas from optimization algorithms on manifolds and introduces a retraction operator, essentially reducing the dimension of the optimization problem. The second method is based on the continuous analogue of the optimization problem. This continuous analogue is an ODE whose equilibrium points are the optima of the constrained optimization problem. This equivalence enables the use of adaptive numerical methods for solving optimization problems with steady-state constraints. Both methods are tailored to the problem structure and exploit the local geometry of the steady-state manifold and its stability properties. A parameterization of the steady-state manifold is not required. The efficiency and reliability of the proposed methods is evaluated using one toy example and two applications. The first application example uses published data while the second uses a novel dataset for Raf/MEK/ERK signaling. The proposed methods demonstrated better convergence properties than state-of-the-art methods employed in systems and computational biology. Furthermore, the average computation time per converged start is significantly lower. In addition to the theoretical results, the analysis of the dataset for Raf/MEK/ERK signaling provides novel biological insights regarding the existence of feedback regulation. Conclusion Many optimization problems considered in systems and computational biology are subject to steady-state constraints. While most optimization methods have convergence problems if these steady-state constraints are highly nonlinear, the methods presented recover the convergence properties of optimizers which can exploit an analytical expression for the parameter-dependent steady state. This renders them an excellent alternative to methods which are currently employed in systems and computational biology.

Application of L<inf>&#x03c1;</inf> Norm Regularization Methods for Modelling Biological Systems

Ising Model Selection Using ℓ_1-Regularized Linear Regression: A Statistical Mechanics Analysis

Identification of Regulatory Variables for State Transition of Biological Networks.

Identifying Latent Dynamic Components in Biological Systems

Uncovering specific mechanisms across cell types in dynamical models

L1 regularization facilitates detection of cell type-specific parameters in dynamical systems

Netreg: Network-Regularized Linear Models for Biological Association Studies

Learning a nonlinear dynamical system model of gene regulation: A perturbed steady-state approach

Tailored Parameter Optimization Methods for Ordinary Differential Equation Models with Steady-State Constraints

Inference of Gene Regulatory Networks Incorporating Multi-Source Biological Knowledge via a State Space Model with L1 Regularization

Parameter Identification for Nonlinear State-Space Models of A Biological Network Via Linearization and Robust State Estimation

Physiology-informed regularization enables training of universal differential equation systems for biological applications

Network estimation in State Space Model with L1-regularization constraint

Linear Programming-Based Sparse Kernel Regression with L1-Norm Minimization for Nonlinear System Modeling

Regularized nonlinear regression for simultaneously selecting and estimating key model parameters: Application to head-neck position tracking

Regularization Methods for High-Dimensional Instrumental Variables Regression With an Application to Genetical Genomics

Optimal Design of Experiments for Simulation-Based Inference of Mechanistic Acyclic Biological Networks

Improving the Robustness of Variable Selection and Predictive Performance of Regularized Generalized Linear Models and Cox Proportional Hazard Models

Inference of Gene Regulatory Networks from Genetic Perturbations with Linear Regression Model

Structure Identification for a Gene Regulation Network by a Sparse Reconstruction Approach

High Dimensional ODEs Coupled with Mixed-Effects Modeling Techniques for Dynamic Gene Regulatory Network Identification

Application of L&lt;inf&gt;&amp;#x03c1;&lt;/inf&gt; Norm Regularization Methods for Modelling Biological Systems