Abstract:Scientists use mathematical modelling to understand and predict the properties of complex physical systems. In highly parameterised models there often exist relationships between parameters over which model predictions are identical, or nearly so. These are known as structural or practical unidentifiabilities, respectively. They are hard to diagnose and make reliable parameter estimation from data impossible. They furthermore imply the existence of an underlying model simplification. We describe a scalable method for detecting unidentifiabilities, and the functional relations defining them, for generic models. This allows for model simplification, and appreciation of which parameters (or functions thereof) cannot be estimated from data. Our algorithm can identify features such as redundant mechanisms and fast timescale subsystems, as well as the regimes in which such approximations are valid. We base our algorithm on a novel quantification of regional parametric sensitivity: multiscale sloppiness. Traditionally, the link between parametric sensitivity and the conditioning of the parameter estimation problem is made locally, through the Fisher Information Matrix. This is valid in the regime of infinitesimal measurement uncertainty. We demonstrate the duality between multiscale sloppiness and the geometry of confidence regions surrounding parameter estimates made where measurement uncertainty is non-negligible. Further theoretical relationships are provided linking multiscale sloppiness to the Likelihood-ratio test. From this, we show that a local sensitivity analysis (as typically done) is insufficient for determining the reliability of parameter estimation, even with simple (non)linear systems. Our algorithm provides a tractable alternative. We finally apply our methods to a large-scale, benchmark Systems Biology model of NF-$\kappa$B, uncovering previously unknown unidentifiabilities.

Parameter identification of complex network dynamics

Parameter Identification for Nonlinear State-Space Models of A Biological Network Via Linearization and Robust State Estimation

Parameters Identification of Passive Force Control System Based on Backstepping Genetic Algorithm

Efficient parameter inference in networked dynamical systems via steady states: A surrogate objective function approach integrating mean-field and nonlinear least squares

NeuralSI: Structural Parameter Identification in Nonlinear Dynamical Systems

Identifying Latent Dynamic Components in Biological Systems

Parameter Identification for Partial Differential Equations with Spatiotemporal Varying Coefficients

A model reference adaptive system approach for nonlinear online parameter identification

Inferring biological networks by sparse identification of nonlinear dynamics

Characterization of Biologically Relevant Network Structures form Time-series Data

Optimizing parameter search for community detection in time-evolving networks of complex systems

Parameter Identification in Power Transmission Systems Based on Graph Convolution Network

Optimizing parameter search for community detection in time evolving networks of complex systems

Network Identification for Diffusively-Coupled Systems with Minimal Time Complexity

Parametric Estimation in Learning Algorithm for Dynamic Neural Networks

Evolutionary multitasking network reconstruction from time series with online parameter estimation

Nonlinear Parameters Identification for Synchronous Generator Excitation Systems

Robust parameter estimation and identifiability analysis with Hybrid Neural Ordinary Differential Equations in Computational Biology

Delineating Parameter Unidentifiabilities in Complex Models

Machine learning in parameter estimation of nonlinear systems

Application of the evolutionary approach to structural and parametric identification of dynamic objects