Abstract:Graph-based unsupervised feature selection methods have successfully processed high-dimensional data since they can effectively preserve data structure information. However, most existing methods are facing two challenges: (1) it is unreliable to exploit the intrinsic spatial structure from raw data because of the existence of redundant information and noise; (2) they only consider the first-order similar information but ignore the high-order similar information ( i . e ., samples with similar neighborhood network structure should be similar to each other). This study proposes an unsupervised feature selection with high-order similarity learning (HSL) to tackle the above problems. The projection matrix, first-order similar information, and high-order similar information are simultaneously learned in a unified framework, such that the intrinsic structure information can be exploited in the clean data that come from a latent low-dimensional embedding subspace. Specifically, we project raw data into a low-dimensional embedding subspace to effectively eliminate redundant information and noise. Moreover, we simultaneously consider the first-order similarity and the high-order similarity in the low-dimensional embedding space so that a better graph Laplacian matrix can be learned to fully preserve the intrinsic structure information of raw data and simultaneously utilize the label information. Furthermore, we design an effective optimization algorithm to tackle the proposed HSL. Comprehensive experiments on real-world datasets verify the superiority and effectiveness of HSL.

A Method of Discriminative Information Preservation and In-Dimension Distance Minimization Method for Feature Selection

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Spectral clustering-based local and global structure preservation for feature selection

A Dimension Reduction Algorithm Preserving Both Global and Local Clustering Structure

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Enhancing Information Discriminant Analysis: Feature Extraction with Linear Statistical Model and Information-Theoretic Criteria.

Joint local structure preservation and redundancy minimization for unsupervised feature selection

Discriminant similarity and variance preserving projection for feature extraction

Unsupervised feature selection with high-order similarity learning

Feature Selection Via Adaptive Spectral Clustering Based on Joint Mutual Information

Low-rank Structure Preserving for Unsupervised Feature Selection

Preserving Local and Global Information: an Effective Metric-based Subspace Clustering

Locality and similarity preserving embedding for feature selection

Feature extraction by dynamically revising the discriminant information in the objective space

Local and global structure preserving based feature selection

Local Discriminative Based Sparse Subspace Learning for Feature Selection

Orthogonal Self-Guided Similarity Preserving Projection for Classification and Clustering.

A novel dimensionality reduction method: Similarity order preserving discriminant analysis

Local and Global Structure Preservation for Robust Unsupervised Spectral Feature Selection