Abstract:Linear latent variable models such as principal component analysis (PCA), independent component analysis (ICA), canonical correlation analysis (CCA), and factor analysis (FA) identify latent directions (or loadings) either ordered or unordered. The data is then projected onto the latent directions to obtain their projected representations (or scores). For example, PCA solvers usually rank the principal directions by explaining the most to least variance, while ICA solvers usually return independent directions unordered and often with single sources spread across multiple directions as multiple sub-sources, which is of severe detriment to their usability and interpretability. This paper proposes a general framework to enhance latent space representations for improving the interpretability of linear latent spaces. Although the concepts in this paper are language agnostic, the framework is written in Python. This framework automates the clustering and ranking of latent vectors to enhance the latent information per latent vector, as well as, the interpretation of latent vectors. Several innovative enhancements are incorporated including latent ranking (LR), latent scaling (LS), latent clustering (LC), and latent condensing (LCON). For a specified linear latent variable model, LR ranks latent directions according to a specified metric, LS scales latent directions according to a specified metric, LC automatically clusters latent directions into a specified number of clusters, while, LCON automatically determines an appropriate number of clusters into which to condense the latent directions for a given metric. Additional functionality of the framework includes single-channel and multi-channel data sources, data preprocessing strategies such as Hankelisation to seamlessly expand the applicability of linear latent variable models (LLVMs) to a wider variety of data. The effectiveness of LR, LS, and LCON are showcased on two crafted foundational problems with two applied latent variable models, namely, PCA and ICA.

Interpreting machine-learning models in transformed feature space with an application to remote-sensing classification

A Framework for Interactive Visual Interpretation of Remote Sensing Data

Exploring local explanations of nonlinear models using animated linear projections

Enhancing Land Cover Mapping and Monitoring: An Interactive and Explainable Machine Learning Approach Using Google Earth Engine

Interpretable Hyperspectral AI: When Non-Convex Modeling meets Hyperspectral Remote Sensing

Representing visual classification as a linear combination of words

Extracting spatial effects from machine learning model using local interpretation method: An example of SHAP and XGBoost

Exploring Wilderness Characteristics Using Explainable Machine Learning in Satellite Imagery

Interpretable Hyperspectral Artificial Intelligence: when Nonconvex Modeling Meets Hyperspectral Remote Sensing

Dynamic Feature Engineering for Transparent Machine Learning: a Framework for Interpretable Model Explanations

An Ensemble Framework for Explainable Geospatial Machine Learning Models

Physics-Inspired Interpretability Of Machine Learning Models

Unifying local and global model explanations by functional decomposition of low dimensional structures

Explaining the Unexplained: Revealing Hidden Correlations for Better Interpretability

Recognizing protected and anthropogenic patterns in landscapes using interpretable machine learning and satellite imagery

Latent Space Perspicacity and Interpretation Enhancement (LS-PIE) Framework

An illustration of model agnostic explainability methods applied to environmental data

Learning outside the Black-Box: The pursuit of interpretable models

Multi-resolution Interpretation and Diagnostics Tool for Natural Language Classifiers

Interpretation and Attribution of Coastal Land Subsidence: An InSAR and Machine Learning Perspective

Disentangling Interpretable Factors with Supervised Independent Subspace Principal Component Analysis