Abstract:Dimension reduction (DR) is commonly utilized to capture the intrinsic structure and transform high-dimensional data into low-dimensional space while retaining meaningful properties of the original data. It is used in various applications, such as image recognition, single-cell sequencing analysis, and biomarker discovery. However, contemporary parametric-free and parametric DR techniques suffer from several significant shortcomings, such as the inability to preserve global and local features and the poor generalisation performance. On the other hand, regarding explainability, it is crucial to comprehend the embedding process, especially the contribution of each part to the embedding process, while understanding how each feature affects the embedding results that identify critical components and help diagnose the embedding process. To address these problems, we have developed a deep neural network method called DMT-EV, which provides not only excellent performance in structural maintainability but also explainability to the DR therein. DMT-EV starts with data augmentation and a manifold-based loss function to improve embedding performance. The explanation is based on saliency maps and aims to examine the trained DMT-EV parameters and contributions of components during the embedding process. The proposed techniques are integrated with a visual interface to help the user to adjust DMT-EV to achieve better DR performance and explainability. The interactive visual interface makes it easier to illustrate the data features, compare different DR techniques, and investigate DR. An in-depth experimental comparison shows that DMT-EV consistently outperforms the state-of-the-art methods in both performance measures and explainability.

Dimensionality Reduction using Residual Encoding Net

DMT-EV: an Explainable Deep Network for Dimension Reduction.

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection.

Dynamic Residual Dense Network For Image Denoising

Dilated Residual Encode-Decode Networks for Image Denoising

Auto-Encoder Based Dimensionality Reduction

Dimensionality Reduction Strategy Based on Auto-Encoder

Image Compressed Sensing Using Residual Enhanced Network

Guided autoencoder for dimensionality reduction of pedestrian features

A restorable autoencoder as a method for dimensionality reduction

Sharing Residual Units Through Collective Tensor Factorization in Deep Neural Networks

Residual encoding framework to compress DNN parameters for fast transfer

Residual Feature-Reutilization Inception Network

A Lightweight Encoder–Decoder Path for Deep Residual Networks

Dimensionality reduction for evolving neural network

An adaptive dimension reduction algorithm for latent variables of variational autoencoder.

Deep Dimension Reduction for Supervised Representation Learning

Deep Recursive Embedding for High-Dimensional Data

Fast, robust, and accurate image denoising via very deeply cascaded residual networks

When Residual Learning Meets Dense Aggregation: Rethinking the Aggregation of Deep Neural Networks