Abstract:Estimating parameters of dynamic models from experimental data is a challenging, and often computationally-demanding task. It requires a large number of model simulations and objective function gradient computations, if gradient-based optimization is used. The gradient depends on derivatives of the state variables with respect to parameters, also called state sensitivities, which are expensive to compute. In many cases, steady-state computation is a part of model simulation, either due to steady-state data or an assumption that the system is at steady state at the initial time point. Various methods are available for steady-state and gradient computation. Yet, the most efficient pair of methods (one for steady states, one for gradients) for a particular model is often not clear. Moreover, depending on the model and the available data, some methods may not be applicable or sufficiently robust. In order to facilitate the selection of methods, we explore six method pairs for computing the steady state and sensitivities at steady state using six real-world problems. The method pairs involve numerical integration or Newton's method to compute the steady-state, and -- for both forward and adjoint sensitivity analysis -- numerical integration or a tailored method to compute the sensitivities at steady-state. Our evaluation shows that the two method pairs that combine numerical integration for the steady-state with a tailored method for the sensitivities at steady-state were the most robust, and amongst the most computationally-efficient. We also observed that while Newton's method for steady-state computation yields a substantial speedup compared to numerical integration, it may lead to a large number of simulation failures. Overall, our study provides a concise overview across current methods for computing sensitivities at steady state, guiding modelers to choose the right methods.

Simultant: simultaneous curve fitting of functions and differential equations using analytical gradient calculations

Numerical Simulation for the System of Ordinary Differential Equations

Optimizing differential equations to fit data and predict outcomes

A simulation-based approach for solving optimisation problems with ODE-type steady state constraints

Gradient Matching Methods for Computational Inference in Mechanistic Models for Systems Biology: A Review and Comparative Analysis

Nonlinear least-squares regression analysis by a simplex method using differential equations containing Michaelis-Menten type rate constants

A nonlinear least squares program based on differential equations, MULTI (RUNGE), for microcomputers

The art of fitting ordinary differential equations models to experimental results

Benchmarking methods for computing local sensitivities in ordinary differential equation models at dynamic and steady states

Numerical simulation of differential-algebraic equations with embedded global optimization criteria

A Function Fitting Method

High accuracy least-squares solutions of nonlinear differential equations

Differentiable Programming for Differential Equations: A Review

Accelerated optimization algorithms and ordinary differential equations: the convex non Euclidean case

On a Stable Multiplicative Calculus-Based Hybrid Parallel Scheme for Nonlinear Equations

Exploration of methods for computing sensitivities in ODE models at dynamic and steady states

Analytically Embedding Differential Equation Constraints into Least Squares Support Vector Machines using the Theory of Functional Connections

PC-based differential model fitting as a support for clinical research

New Methods for Parametric Optimization via Differential Equations

Adjoint-based calibration of nonlinear stochastic differential equations