Abstract:Dimension reduction (DR) is commonly utilized to capture the intrinsic structure and transform high-dimensional data into low-dimensional space while retaining meaningful properties of the original data. It is used in various applications, such as image recognition, single-cell sequencing analysis, and biomarker discovery. However, contemporary parametric-free and parametric DR techniques suffer from several significant shortcomings, such as the inability to preserve global and local features and the poor generalisation performance. On the other hand, regarding explainability, it is crucial to comprehend the embedding process, especially the contribution of each part to the embedding process, while understanding how each feature affects the embedding results that identify critical components and help diagnose the embedding process. To address these problems, we have developed a deep neural network method called DMT-EV, which provides not only excellent performance in structural maintainability but also explainability to the DR therein. DMT-EV starts with data augmentation and a manifold-based loss function to improve embedding performance. The explanation is based on saliency maps and aims to examine the trained DMT-EV parameters and contributions of components during the embedding process. The proposed techniques are integrated with a visual interface to help the user to adjust DMT-EV to achieve better DR performance and explainability. The interactive visual interface makes it easier to illustrate the data features, compare different DR techniques, and investigate DR. An in-depth experimental comparison shows that DMT-EV consistently outperforms the state-of-the-art methods in both performance measures and explainability.

Interpreting High-Dimensional Projections With Capacity

Interpreting High-Dimensional Projections with Capacity.

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection.

DMT-EV: an Explainable Deep Network for Dimension Reduction.

Saliency-Aware Projection Usability Enhancement for Dimensionality Reduction Through Generative Models

A Perception-Driven Approach to Supervised Dimensionality Reduction for Visualization

Dynamic visualization of high-dimensional data

Exploring high-dimensional data through locally enhanced projections.

Discriminant Hyper-Laplacian Projections and Its Scalable Extension for Dimensionality Reduction

Multi-point dimensionality reduction to improve projection layout reliability

A Visual Interaction Framework for Dimensionality Reduction Based Data Exploration

A survey of dimensionality reduction techniques based on random projection

Cluster Exploration using Informative Manifold Projections

Out-of-Core Dimensionality Reduction for Large Data via Out-of-Sample Extensions

DMT-HI: MOE-based Hyperbolic Interpretable Deep Manifold Transformation for Unspervised Dimensionality Reduction

Ten quick tips for effective dimensionality reduction

Dimension Projection Matrix/Tree: Interactive Subspace Visual Exploration and Analysis of High Dimensional Data

Towards Making High Dimensional Distance Metric Learning Practical

Dimension Reconstruction for Visual Exploration of Subspace Clusters in High-Dimensional Data.

Exploring Dimensionality Reductions with Forward and Backward Projections