Abstract:Scientists use mathematical modelling to understand and predict the properties of complex physical systems. In highly parameterised models there often exist relationships between parameters over which model predictions are identical, or nearly so. These are known as structural or practical unidentifiabilities, respectively. They are hard to diagnose and make reliable parameter estimation from data impossible. They furthermore imply the existence of an underlying model simplification. We describe a scalable method for detecting unidentifiabilities, and the functional relations defining them, for generic models. This allows for model simplification, and appreciation of which parameters (or functions thereof) cannot be estimated from data. Our algorithm can identify features such as redundant mechanisms and fast timescale subsystems, as well as the regimes in which such approximations are valid. We base our algorithm on a novel quantification of regional parametric sensitivity: multiscale sloppiness. Traditionally, the link between parametric sensitivity and the conditioning of the parameter estimation problem is made locally, through the Fisher Information Matrix. This is valid in the regime of infinitesimal measurement uncertainty. We demonstrate the duality between multiscale sloppiness and the geometry of confidence regions surrounding parameter estimates made where measurement uncertainty is non-negligible. Further theoretical relationships are provided linking multiscale sloppiness to the Likelihood-ratio test. From this, we show that a local sensitivity analysis (as typically done) is insufficient for determining the reliability of parameter estimation, even with simple (non)linear systems. Our algorithm provides a tractable alternative. We finally apply our methods to a large-scale, benchmark Systems Biology model of NF-$\kappa$B, uncovering previously unknown unidentifiabilities.

Uncertainty Analysis for Non-identifiable Dynamical Systems: Profile Likelihoods, Bootstrapping and More

Dynamical System Identification, Model Selection and Model Uncertainty Quantification by Bayesian Inference

Uncertainty quantification in system identification

Identifying Latent Dynamic Components in Biological Systems

Quantification of Model Uncertainty: Calibration, Model Discrepancy, and Identifiability

Stability and Reliability Analysis of Nonlinear Stochastic System Using Data-Driven Dimensional Analysis Method

Probabilistic forecast of nonlinear dynamical systems with uncertainty quantification

Preposterior Analysis to Select Experimental Responses for Improving Identifiability in Model Uncertainty Quantification

Efficient inference and identifiability analysis for differential equation models with random parameters

Likelihood based observability analysis and confidence intervals for predictions of dynamic models

UNCERTAINTY ANALYSIS METHOD BASED ON A COMBINATION OF THE MAXIMUM ENTROPY PRINCIPLE AND THE POINT ESTIMATION METHOD

Uncertainty components in profile likelihood fits

Structural stochastic identification considering modeling uncertainty through sparse grid and similar system analysis

Structural Identifiability of Dynamic Systems Biology Models

Delineating Parameter Unidentifiabilities in Complex Models

Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discovery

Probability Assessments of Identified Parameters for Stochastic Structures Using Point Estimation Method

Implementing measurement error models with mechanistic mathematical models in a likelihood-based framework for estimation, identifiability analysis, and prediction in the life sciences

Efficient reliability analysis of complex systems in consideration of imprecision

Profile-Wise Analysis: A profile likelihood-based workflow for identifiability analysis, estimation, and prediction with mechanistic mathematical models