Abstract:Dimensional reduction~(DR) maps high-dimensional data into a lower dimensions latent space with minimized defined optimization objectives. The DR method usually falls into feature selection~(FS) and feature projection~(FP). FS focuses on selecting a critical subset of dimensions but risks destroying the data distribution (structure). On the other hand, FP combines all the input features into lower dimensions space, aiming to maintain the data structure; but lacks interpretability and sparsity. FS and FP are traditionally incompatible categories; thus, they have not been unified into an amicable framework. We propose that the ideal DR approach combines both FS and FP into a unified end-to-end manifold learning framework, simultaneously performing fundamental feature discovery while maintaining the intrinsic relationships between data samples in the latent space. In this work, we develop a unified framework, Unified Dimensional Reduction Neural-network~(UDRN), that integrates FS and FP in a compatible, end-to-end way. We improve the neural network structure by implementing FS and FP tasks separately using two stacked sub-networks. In addition, we designed data augmentation of the DR process to improve the generalization ability of the method when dealing with extensive feature datasets and designed loss functions that can cooperate with the data augmentation. Extensive experimental results on four image and four biological datasets, including very high-dimensional data, demonstrate the advantages of DRN over existing methods~(FS, FP, and FS\&FP pipeline), especially in downstream tasks such as classification and visualization.

Unsupervised dimensionality reduction based on fractal dimension and genetic algorithm

On Combining Fractal Dimension with GA for Feature Subset Selecting

A Two Phases Unsupervised Sequential Forward Fractal Dimensionality Reduction Algorithm

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

The practical method of fractal dimensionality reduction based on z-ordering technique

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

A GA-Based Feature Selection for High-Dimensional Data Clustering

A Novel Unsupervised Feature Selection Approach Using Genetic Algorithm on Partitioned Data

Performance Optimization of Fractal Dimension Based Feature Selection Algorithm

Fast and Robust Unsupervised Dimensionality Reduction with Adaptive Bipartite Graphs

A Novel Unsupervised Feature Selection for High-Dimensional Data Based on FCM and $k$ -Nearest Neighbor Rough Sets

Fast Attribute Selection Algorithm Based on Fractal Dimension

Discriminative Unsupervised Dimensionality Reduction.

Feature Selection Based on Genetic Algorithm With Stochastic Disturbance Local Optimization

Fractal Autoencoders for Feature Selection

A Ga-Based Feature Selection and Ensemble Learning for High-Dimensional Datasets

Dependence Guided Unsupervised Feature Selection

A Feature Selection Framework Based on Supervised Data Clustering

Adaptive Dimension Reduction for Clustering High Dimensional Data

Generalized Uncorrelated Regression with Adaptive Graph for Unsupervised Feature Selection