Abstract:By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the so-called curse of dimensionality. Most existing matrix factorization-based unsupervised feature selection methods are built upon subspace learning, but they have limitations in capturing nonlinear structural information among features. It is well-known that kernel techniques can capture nonlinear structural information. In this paper, we construct a model by integrating kernel functions and kernel alignment, which can be equivalently characterized as a matrix factorization problem. However, such an extension raises another issue: the algorithm performance heavily depends on the choice of kernel, which is often unknown a priori. Therefore, we further propose a multiple kernel-based learning method. By doing so, our model can learn both linear and nonlinear similarity information and automatically generate the most appropriate kernel. Experimental analysis on real-world data demonstrates that the two proposed methods outperform other classic and state-of-the-art unsupervised feature selection methods in terms of clustering results and redundancy reduction in almost all datasets tested.

Feature Selection Based on Kernel Pattern Similarity.

Feature Expansion and Feature Selection for General Pattern Recognition Problems

Feature Selection in a Kernel Space

Distance-Based Classifier Via the Kernel Trick.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Unsupervised Discriminative Feature Selection in a Kernel Space Via L2, 1-Norm Minimization.

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

Adaptive kernel subspace method for speeding up feature extraction

TAKES: a fast method to select features in the kernel space.

Optimal Feature Selection for Sparse Linear Discriminant Analysis and Its Applications in Gene Expression Data.

Bilinear Analysis for Kernel Selection and Nonlinear Feature Extraction

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Sparse Feature Selection in Kernel Discriminant Analysis via Optimal Scoring

Nonparametric Dimension Reduction Via Maximizing Pairwise Separation Probability.

FS_SFS: A Novel Feature Selection Method for Support Vector Machines

On Feature Extraction Via Kernels

An Efficient Kernel Evaluation Criterion for Multiclass Classification

Kernel Alignment for Unsupervised Feature Selection via Matrix Factorization

A Hybrid Feature Selection Approach by Correlation-Based Filters and SVM-RFE