Abstract:Dimensional reduction (DR) maps high-dimensional data into a lower dimensions latent space with minimized defined optimization objectives. The two independent branches of DR are feature selection (FS) and feature projection (FP). FS focuses on selecting a critical subset of dimensions but risks destroying the data distribution (structure). On the other hand, FP combines all the input features into lower dimensions space, aiming to maintain the data structure, but lacks interpretability and sparsity. Moreover, FS and FP are traditionally incompatible categories and have not been unified into an amicable framework. Therefore, we consider that the ideal DR approach combines both FS and FP into a unified end-to-end manifold learning framework, simultaneously performing fundamental feature discovery while maintaining the intrinsic relationships between data samples in the latent space. This paper proposes a unified framework named Unified Dimensional Reduction Network (UDRN) to integrate FS and FP in an end-to-end way. Furthermore, a novel network framework is designed to implement FS and FP tasks separately using a stacked feature selection network and feature projection network. In addition, a stronger manifold assumption and a novel loss function are proposed. Furthermore, the loss function can leverage the priors of data augmentation to enhance the generalization ability of the proposed UDRN. Finally, comprehensive experimental results on four image and four biological datasets, including very high-dimensional data, demonstrate the advantages of DRN over existing methods (FS, FP, and FS&FP pipeline), especially in downstream tasks such as classification and visualization.

Dimensionality Reduction Method Based on Restrained Boltzmann Machine Neural Network with Principal Component Analysis

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection.

Deep Manifold Transformation for Dimension Reduction

An MPCA/LDA Based Dimensionality Reduction Algorithm for Face Recognition

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

nPCA: a linear dimensionality reduction method using a multilayer perceptron

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Facial Feature Tracking under Varying Facial Expressions and Face Poses based on Restricted Boltzmann Machines

A Brief Survey of Dimension Reduction

Parts-Based holistic face recognition with RBF neural networks

Reducing the Dimensionality of SPD Matrices with Neural Networks in BCI

Restricted Boltzmann Machine with Adaptive Local Hidden Units.

Face Recognition Based on CD-RBM and BM-ILM

New Nonlinear Principal Analysis Method Based on RBF Neural Network

Bilateral Two-Dimensional Principal Component Analysis with its Application to Face Recognition

Nonnegative Restricted Boltzmann Machines for Parts-based Representations Discovery and Predictive Model Stabilization

Comparative Research on Methods of Dimensionality Reduction in High-Dimension Medical Data

Coupled discriminative manifold alignment for low-resolution face recognition

An Approach to Image Dimension Reduction and Its Application to Face Images

Joint Dimensionality Reduction for Face Recognition Based on D-KSVD.