Abstract:Linear latent variable models such as principal component analysis (PCA), independent component analysis (ICA), canonical correlation analysis (CCA), and factor analysis (FA) identify latent directions (or loadings) either ordered or unordered. The data is then projected onto the latent directions to obtain their projected representations (or scores). For example, PCA solvers usually rank the principal directions by explaining the most to least variance, while ICA solvers usually return independent directions unordered and often with single sources spread across multiple directions as multiple sub-sources, which is of severe detriment to their usability and interpretability. This paper proposes a general framework to enhance latent space representations for improving the interpretability of linear latent spaces. Although the concepts in this paper are language agnostic, the framework is written in Python. This framework automates the clustering and ranking of latent vectors to enhance the latent information per latent vector, as well as, the interpretation of latent vectors. Several innovative enhancements are incorporated including latent ranking (LR), latent scaling (LS), latent clustering (LC), and latent condensing (LCON). For a specified linear latent variable model, LR ranks latent directions according to a specified metric, LS scales latent directions according to a specified metric, LC automatically clusters latent directions into a specified number of clusters, while, LCON automatically determines an appropriate number of clusters into which to condense the latent directions for a given metric. Additional functionality of the framework includes single-channel and multi-channel data sources, data preprocessing strategies such as Hankelisation to seamlessly expand the applicability of linear latent variable models (LLVMs) to a wider variety of data. The effectiveness of LR, LS, and LCON are showcased on two crafted foundational problems with two applied latent variable models, namely, PCA and ICA.

Understanding the Probabilistic Latent Component Analysis Framework

Sparse Probabilistic Principal Component Analysis Model for Plant-Wide Process Monitoring

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Structured Principal Component Analysis Model With Variable Correlation Constraint

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

Probabilistic Learning of Partial Least Squares Regression Model: Theory and Industrial Applications

Latent Space Perspicacity and Interpretation Enhancement (LS-PIE) Framework

Probabilistic latent variable regression model for process-quality monitoring

Robust Monitoring and Fault Reconstruction Based on Variational Inference Component Analysis

Latent Variable Models for Dimensionality Reduction

Process Data Analytics Via Probabilistic Latent Variable Models: A Tutorial Review

Non-Gaussian Industrial Process Monitoring with Probabilistic Independent Component Analysis

Analyzing and Improving Supervised Nonlinear Dynamical Probabilistic Latent Variable Model for Inferential Sensors

Robust modeling of mixture probabilistic principal component analysis and process monitoring application

Nonlinear Probabilistic Monitoring Based on the Gaussian Process Latent Variable Model

Bayesian Robust Principal Component Analysis with Adaptive Singular Value Penalty

Nonlinear Probabilistic Latent Variable Regression Models for Soft Sensor Application: from Shallow to Deep Structure

Dynamic Process Monitoring Based on Probabilistic Principle Component Regression

Generalized probabilistic principal component analysis of correlated data

PLPCA: Persistent Laplacian-Enhanced PCA for Microarray Data Analysis

Proximal Interacting Particle Langevin Algorithms