Abstract:Dimension reduction (DR) is commonly utilized to capture the intrinsic structure and transform high-dimensional data into low-dimensional space while retaining meaningful properties of the original data. It is used in various applications, such as image recognition, single-cell sequencing analysis, and biomarker discovery. However, contemporary parametric-free and parametric DR techniques suffer from several significant shortcomings, such as the inability to preserve global and local features and the pool generalization performance. On the other hand, regarding explainability, it is crucial to comprehend the embedding process, especially the contribution of each part to the embedding process, while understanding how each feature affects the embedding results that identify critical components and help diagnose the embedding process. To address these problems, we have developed a deep neural network method called EVNet, which provides not only excellent performance in structural maintainability but also explainability to the DR therein. EVNet starts with data augmentation and a manifold-based loss function to improve embedding performance. The explanation is based on saliency maps and aims to examine the trained EVNet parameters and contributions of components during the embedding process. The proposed techniques are integrated with a visual interface to help the user to adjust EVNet to achieve better DR performance and explainability. The interactive visual interface makes it easier to illustrate the data features, compare different DR techniques, and investigate DR. An in-depth experimental comparison shows that EVNet consistently outperforms the state-of-the-art methods in both performance measures and explainability.

What problem does this paper attempt to address?

The main problems that this paper attempts to solve are the deficiencies of existing dimension reduction (DR) techniques in maintaining global and local features and the lack of interpretability. Specifically: 1. **Retention of global and local features**: Existing non - parametric and parametric dimension reduction techniques cannot well preserve the global and local features of data, resulting in the reduced - dimension data losing important characteristics of the original data. 2. **Interpretability problem**: Traditional dimension reduction methods are like "black boxes", and it is difficult to understand their embedding processes, especially the influence of each feature on the dimension reduction results. This is particularly important for application scenarios that require interpretability (such as biomedical research). To solve these problems, the author proposes a dimension reduction method based on deep neural networks - EVNet (Explainable Visualization Network), which not only improves the dimension reduction performance but also enhances the interpretability of the model. EVNet achieves these goals in the following ways: - **Data augmentation**: Introduce data augmentation as prior knowledge to improve the generalization ability and interpretability of the model. - **New loss function**: Design a manifold - based loss function \(L_{sp}\), which is compatible with data augmentation and calculates data similarity in the latent space, avoiding the direct use of input data similarity. - **Explanation mechanism**: Use tools such as saliency maps to explain the trained EVNet parameters and the contributions of each component in the embedding process. - **Interactive visualization interface**: Integrate an interactive visualization interface to help users adjust EVNet to obtain better dimension reduction performance and interpretability. Through these improvements, EVNet can show better performance than existing methods on multiple image and biological datasets and provide clearer interpretability.

EVNet: An Explainable Deep Network for Dimension Reduction

DMT-EV: an Explainable Deep Network for Dimension Reduction.

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection.

Deep Manifold Transformation for Dimension Reduction

Which Neural Network Makes More Explainable Decisions? an Approach Towards Measuring Explainability

Deep Clustering and Visualization for End-to-End High-Dimensional Data Analysis.

Invertible Manifold Learning for Dimension Reduction

Deep Recursive Embedding for High-Dimensional Data

Embedding deep networks into visual explanations

Explainability Tools Enabling Deep Learning in Future In-Situ Real-Time Planetary Explorations

Improving Network Interpretability via Explanation Consistency Evaluation

Graph Embedding-Based Dimension Reduction With Extreme Learning Machine.

DimVis: Interpreting Visual Clusters in Dimensionality Reduction With Explainable Boosting Machine

Deep Recursive Network Embedding With Regular Equivalence

Explaining Deep Convolutional Neural Networks for Image Classification by Evolving Local Interpretable Model-agnostic Explanations

Gradient-based explanation for non-linear non-parametric dimensionality reduction

DR-Net: An Improved Network for Building Extraction from High Resolution Remote Sensing Image

Less is More: Discovering Concise Network Explanations

DMT-HI: MOE-based Hyperbolic Interpretable Deep Manifold Transformation for Unspervised Dimensionality Reduction