Abstract:Dimensionality reduction (DR) techniques are used for various purposes such as exploratory data analysis. A commonly employed linear DR technique is principal component analysis (PCA), which is one of the most popular methods for DR. Owing to its linear nature, PCA enables the determination of axes in a low‐dimensional space and the calculation of corresponding loading vectors. However, PCA cannot necessarily extract important features of non‐linearly distributed data. This study presents a technique aimed at aiding the interpretation of data reduced through non‐linear DR methods. In the proposed method, non‐linear dimensionally reduced data was clustered via a density‐based clustering method. Thereafter, the obtained cluster labels were classified by random forest (RF) classifiers. Further, feature importance (FI) of RF classifiers and Spearman's rank correlation coefficients between predictive probabilities to obtained clusters and original feature values were utilized for characterizing the visualized dimensionally reduced data. The results revealed that the proposed method can provide the interpretable FI‐based images of the handwritten digits dataset. Moreover, the proposed method was also applied to the polymer dataset. The study found that incorporating signed FI was advantageous in achieving a meaningful interpretation. Furthermore, Gaussian process regression was utilized to produce intuitive FI‐based heatmaps on a 2‐dimensional space for greater ease of understanding. Additionally, to enhance the interpretability of the obtained clusters, a feature selection technique called Boruta was applied. The Boruta feature selection method worked effectively to interpret the obtained clusters with limited and commonly important features. Additionally, the study suggested that computing FI solely from substructure‐based descriptors could further enhance the interpretability of the results. Finally, the automation of the proposed method was investigated, and through maximizing the target score based on the quality of both the DR and clustering, indicative results were automatically obtained for both the handwritten digits and polymer datasets.

Entropic Wasserstein Component Analysis

Locality Pursuit Embedding

Interpolating between Clustering and Dimensionality Reduction with Gromov-Wasserstein

Modern Dimension Reduction

Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualization

Invertible Manifold Learning for Dimension Reduction

Wasserstein principal component analysis for circular measures

Intrinsic Correlation Analysis for Wasserstein Functional Data

Cluster Exploration using Informative Manifold Projections

Intrinsic Wasserstein Correlation Analysis

Feature importance‐based interpretation of UMAP‐visualized polymer space

Dirichlet component analysis: feature extraction for compositional data

Out-of-Core Dimensionality Reduction for Large Data via Out-of-Sample Extensions

Distributional Reduction: Unifying Dimensionality Reduction and Clustering with Gromov-Wasserstein

Statistical embedding: Beyond principal components

On Probabilistic Embeddings in Optimal Dimension Reduction

Wasserstein Wormhole: Scalable Optimal Transport Distance with Transformers

Transductive Component Analysis

$O(k)$-Equivariant Dimensionality Reduction on Stiefel Manifolds

A Perception-Driven Approach to Supervised Dimensionality Reduction for Visualization

Wasserstein Spatial Depth