Abstract:Dimensional reduction (DR) maps high-dimensional data into a lower dimensions latent space with minimized defined optimization objectives. The two independent branches of DR are feature selection (FS) and feature projection (FP). FS focuses on selecting a critical subset of dimensions but risks destroying the data distribution (structure). On the other hand, FP combines all the input features into lower dimensions space, aiming to maintain the data structure, but lacks interpretability and sparsity. Moreover, FS and FP are traditionally incompatible categories and have not been unified into an amicable framework. Therefore, we consider that the ideal DR approach combines both FS and FP into a unified end-to-end manifold learning framework, simultaneously performing fundamental feature discovery while maintaining the intrinsic relationships between data samples in the latent space. This paper proposes a unified framework named Unified Dimensional Reduction Network (UDRN) to integrate FS and FP in an end-to-end way. Furthermore, a novel network framework is designed to implement FS and FP tasks separately using a stacked feature selection network and feature projection network. In addition, a stronger manifold assumption and a novel loss function are proposed. Furthermore, the loss function can leverage the priors of data augmentation to enhance the generalization ability of the proposed UDRN. Finally, comprehensive experimental results on four image and four biological datasets, including very high-dimensional data, demonstrate the advantages of DRN over existing methods (FS, FP, and FS&FP pipeline), especially in downstream tasks such as classification and visualization.

Unsupervised Discriminant Projection Analysis for Feature Extr

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection.

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

A Multilinear Unsupervised Discriminant Projections Method for Feature Extraction

Local Feature Discriminant Projection

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Unsupervised multi-manifold linear differential projection(UMLDP) for face recognition

Low-rank Representation Based Discriminative Projection for Robust Feature Extraction

Fuzzy local discriminant embedding for image feature extraction

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Sparse Local Discriminant Projections for Feature Extraction

Collaborative Representation Based Local Discriminant Projection for Feature Extraction

Locality-based Linear Discriminant Projection

Sparse Fuzzy Two-Dimensional Discriminant Local Preserving Projection (SF2DDLPP) for Robust Image Feature Extraction

Discriminant similarity and variance preserving projection for feature extraction

Face Recognition Using Data Driven Local Appearance Features

Feature extraction using maximum nonparametric margin projection.

Two-Dimensional Exponential Sparse Discriminant Local Preserving Projections

Nonnegative Representation Based Discriminant Projection for Face Recognition.

Local similarity preserving projections for face recognition