Abstract:A novel information-theoretic approach is proposed to assess the global practical identifiability of Bayesian statistical models. Based on the concept of conditional mutual information, an estimate of information gained for each model parameter is used to quantify the identifiability with practical considerations. No assumptions are made about the structure of the statistical model or the prior distribution while constructing the estimator. The estimator has the following notable advantages: first, no controlled experiment or data is required to conduct the practical identifiability analysis; second, unlike popular variance-based global sensitivity analysis methods, different forms of uncertainties, such as model-form, parameter, or measurement can be taken into account; third, the identifiability analysis is global, and therefore independent of a realization of the parameters. If an individual parameter has low identifiability, it can belong to an identifiable subset such that parameters within the subset have a functional relationship and thus have a combined effect on the statistical model. The practical identifiability framework is extended to highlight the dependencies between parameter pairs that emerge a posteriori to find identifiable parameter subsets. The applicability of the proposed approach is demonstrated using a linear Gaussian model and a non-linear methane-air reduced kinetics model. It is shown that by examining the information gained for each model parameter along with its dependencies with other parameters, a subset of parameters that can be estimated with high posterior certainty can be found.

Identifiability of multivariate logistic mixture models

On Parameter Identifiability of Linear Multivariable Systems with Communication Access Constraints

Generalized Identifiability Bounds for Mixture Models with Grouped Samples

Identifiability of Normal and Normal Mixture Models With Nonignorable Missing Data

A Nonparametric Estimation Method for the Multivariate Mixture Models

On the global identifiability of logistic regression models with misclassified outcomes

Strong identifiability and parameter learning in regression with heterogeneous response

Synthetic Potential Outcomes and Causal Mixture Identifiability

Mixture models for simultaneous classification and reduction of three-way data

An Empirical Likelihood Method In Mixture Models With Incomplete Classifications

The Infinite Student'S T-Mixture For Robust Modeling

Estimating Global Identifiability Using Conditional Mutual Information in a Bayesian Framework

Learning Mixed Multinomial Logits with Provable Guarantees

A mixture logistic model for panel data with a Markov structure

Identifiability of A Mixture Cure Frailty Model

On the Identifiability of Diagnostic Classification Models.

Gaussian Mixture Identifiability from degree 6 Moments

Semi-supervised Logistic Learning Based on Exponential Tilt Mixture Models

Provable Subspace Identification Under Post-Nonlinear Mixtures

IDENTIFIABILITY OF BIFACTOR MODELS

Testing Homogeneity in A Multivariate Mixture Model