Abstract:Estimating parameters of dynamic models from experimental data is a challenging, and often computationally-demanding task. It requires a large number of model simulations and objective function gradient computations, if gradient-based optimization is used. The gradient depends on derivatives of the state variables with respect to parameters, also called state sensitivities, which are expensive to compute. In many cases, steady-state computation is a part of model simulation, either due to steady-state data or an assumption that the system is at steady state at the initial time point. Various methods are available for steady-state and gradient computation. Yet, the most efficient pair of methods (one for steady states, one for gradients) for a particular model is often not clear. Moreover, depending on the model and the available data, some methods may not be applicable or sufficiently robust. In order to facilitate the selection of methods, we explore six method pairs for computing the steady state and sensitivities at steady state using six real-world problems. The method pairs involve numerical integration or Newton's method to compute the steady-state, and -- for both forward and adjoint sensitivity analysis -- numerical integration or a tailored method to compute the sensitivities at steady-state. Our evaluation shows that the two method pairs that combine numerical integration for the steady-state with a tailored method for the sensitivities at steady-state were the most robust, and amongst the most computationally-efficient. We also observed that while Newton's method for steady-state computation yields a substantial speedup compared to numerical integration, it may lead to a large number of simulation failures. Overall, our study provides a concise overview across current methods for computing sensitivities at steady state, guiding modelers to choose the right methods.

Dynamic optimization of nonlinear differential game problems using orthogonal collocation with analytical sensitivities

A Novel Analytical Second‐order Sensitivity Calculation Approach Using the Finite Element Method for Chemical Engineering Problems

Analytical Sensitivity Computation Using Collocation Method with Non-Uniform Mesh Discretisation for Numerical Solutions of Optimal Control Problems

Direct Approaches for PDE-constrained Dynamic Optimization Based on Space–time Orthogonal Collocation on Finite Elements

An Adaptive Pseudospectral Method for Constrained Dynamic Optimization Problems in Chemical Engineering

An Effective Simultaneous Approach with Variable Time Nodes for Dynamic Optimization Problems

A Quasi-Sequential Algorithm for PDE-constrained Optimization Based on Space–time Orthogonal Collocation on Finite Elements

Simultaneous Orthogonal Collocation Decomposition Method for Extended Lion and Man Problems

An Effective Pseudospectral Method for Constraint Dynamic Optimisation Problems with Characteristic Times

Global Versus Local Orthogonal Collocation in Simultaneous Approach

A Bilevel NLP Sensitivity‐based Decomposition for Dynamic Optimization with Moving Finite Elements

A Model Predictive Stackelberg Solution to Orbital Pursuit-Evasion Game

A Simultaneous Strategy For Dynamic Optimization Based On Symbolic Derivation

A Fast Dynamic Optimization Approach for Transient Stability Emergency Control

Safety Envelope for Orthogonal Collocation Methods in Embedded Optimal Control

Improved orthogonal collocation method and its application to dynamic optimization problems of chemical process

Optimal avoidance strategy based on nonlinear approximate analytic solution of non-cooperative differential game

Newton’s Method, Bellman Recursion and Differential Dynamic Programming for Unconstrained Nonlinear Dynamic Games

Exploration of methods for computing sensitivities in ODE models at dynamic and steady states

A discrete adjoint gradient approach for equality and inequality constraints in dynamics

The computation of approximate feedback Stackelberg equilibria in multi-player nonlinear constrained dynamic games