Abstract:Scientists use mathematical modelling to understand and predict the properties of complex physical systems. In highly parameterised models there often exist relationships between parameters over which model predictions are identical, or nearly so. These are known as structural or practical unidentifiabilities, respectively. They are hard to diagnose and make reliable parameter estimation from data impossible. They furthermore imply the existence of an underlying model simplification. We describe a scalable method for detecting unidentifiabilities, and the functional relations defining them, for generic models. This allows for model simplification, and appreciation of which parameters (or functions thereof) cannot be estimated from data. Our algorithm can identify features such as redundant mechanisms and fast timescale subsystems, as well as the regimes in which such approximations are valid. We base our algorithm on a novel quantification of regional parametric sensitivity: multiscale sloppiness. Traditionally, the link between parametric sensitivity and the conditioning of the parameter estimation problem is made locally, through the Fisher Information Matrix. This is valid in the regime of infinitesimal measurement uncertainty. We demonstrate the duality between multiscale sloppiness and the geometry of confidence regions surrounding parameter estimates made where measurement uncertainty is non-negligible. Further theoretical relationships are provided linking multiscale sloppiness to the Likelihood-ratio test. From this, we show that a local sensitivity analysis (as typically done) is insufficient for determining the reliability of parameter estimation, even with simple (non)linear systems. Our algorithm provides a tractable alternative. We finally apply our methods to a large-scale, benchmark Systems Biology model of NF-$\kappa$B, uncovering previously unknown unidentifiabilities.

Identifiability of Polynomial Models from First Principles and via a Gröbner Basis Approach

The numerical statistical fan for noisy experimental designs

The Number of Gröbner Bases in Finite Fields

Sparse identification of posynomial models

Geometric characterization of data sets with unique reduced Gröbner bases

Parametrized systems of generalized polynomial inequalitites via linear algebra and convex geometry

Refined dual Grothendieck polynomials, integrability, and the Schur measure

Discovery of statistical equivalence classes using computer algebra

The semi-algebraic geometry of saturated optimal designs for the Bradley-Terry model

An Algebraic Geometric Approach to the Identification of A Class of Linear Hybrid Systems

Identifiability and dependence structure in factor models through monomial assignments in determinantal decompositions

Delineating Parameter Unidentifiabilities in Complex Models

Identifiable specializations for ODE models

Polynomial spline estimation for partial functional linear regression models

Geometric involutive bases for positive dimensional polynomial ideals and SDP methods

Invariant Generation for Multi-Path Loops with Polynomial Assignments

Extracting Linear Relations from Gröbner Bases for Formal Verification of And-Inverter Graphs

Integration on complex Grassmannians, deformed monotone Hurwitz numbers, and interlacing phenomena

Partial identification in nonseparable binary response models with endogenous regressors

Point-identification in multivariate nonseparable triangular models

Incomplete Gröbner Basis As a Preconditioner for Polynomial Systems