Abstract:Unsupervised Feature Selection (UFS) methods are known to produce models with excellent ability to select high-quality features. This advantage, however, is challenged when analyzing noisy real-world data, where anomalies are prevalent. For example, there may be a feature (anomalous feature) that is corrupted across many samples or a sample (anomalous sample) that has more corruptions than its peers. Previous literature focused on addressing anomalous samples, and methods that are robust to both types of anomalies have been under-explored. This paper proposes a novel general framework for reconstruction-based UFS methods, which can be embedded into the feature learning process to simultaneously remove anomalous samples and features. Specifically, the framework learns double binary weight vectors to assign 0 weights to samples or features with the highest reconstruction errors and 1 weights to the others when computing reconstruction errors. By discarding the 0-weighted samples and features when updating the model parameters, the anomalies in the data are excluded. This allows the model to focus more on learning from the clean part of the noisy data. Our proposed framework is then integrated with AutoEncoder Feature Selector (AEFS [10] ) to develop a new method, which jointly performs anomaly removal and feature selection. The experimental results demonstrate the effectiveness of the proposed framework. Particularly, processing both types of anomalies provides better robustness than processing only one type. Moreover, our proposed method outperforms several state-of-the-art methods on various real-world datasets.

Robust Feature Selection Method Via Joint Low-Rank Reconstruction and Projection Reconstruction

Robust Unsupervised Feature Selection Based on Sparse Reconstruction of Learned Clean Data

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Graph Regularized Feature Selection with Data Reconstruction

Interpretable Robust Feature Selection via Joint -Norms Minimization.

Unsupervised feature extraction by low-rank and sparsity preserving embedding

Robust Neighborhood Embedding for Unsupervised Feature Selection.

Adaptive Weighted Sparse Principal Component Analysis for Robust Unsupervised Feature Selection

Unsupervised Feature Selection Via Joint Local Learning and Group Sparse Regression

Robust Manifold Matrix Factorization for Joint Clustering and Feature Extraction.

Joint local structure preservation and redundancy minimization for unsupervised feature selection

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

Robust autoencoder feature selector for unsupervised feature selection

New Feature Selection Methods Using Sparse Representation for One-Class Classification of Remote Sensing Images

Unsupervised Feature Selection via Nonnegative Orthogonal Constrained Regularized Minimization

A Hybrid Feature Selection Approach by Correlation-Based Filters and SVM-RFE

Joint Adaptive Graph Learning and Discriminative Analysis for Unsupervised Feature Selection

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

Hierarchical Feature Selection for Random Projection