Abstract:The selection of most informative and discriminative features from high-dimensional data has been noticed as an important topic in machine learning and data engineering. Using matrix factorization-based techniques such as nonnegative matrix factorization for feature selection has emerged as a hot topic in feature selection. The main goal of feature selection using matrix factorization is to extract a subspace which approximates the original space but in a lower dimension. In this study, rank revealing QR (RRQR) factorization, which is computationally cheaper than singular value decomposition (SVD), is leveraged in obtaining the most informative features as a novel unsupervised feature selection technique. This technique uses the permutation matrix of QR for feature selection which is a unique property to this factorization method. Moreover, QR factorization is embedded into non-negative matrix factorization (NMF) objective function as a new unsupervised feature selection method. Lastly, a hybrid feature selection algorithm is proposed by coupling RRQR, as a filter-based technique, and a Genetic algorithm as a wrapper-based technique. In this method, redundant features are removed using RRQR factorization and the most discriminative subset of features are selected using the Genetic algorithm. The proposed algorithm shows to be dependable and robust when compared against state-of-the-art feature selection algorithms in supervised, unsupervised, and semi-supervised settings. All methods are tested on seven available microarray datasets using KNN, SVM and C4.5 classifiers. In terms of evaluation metrics, the experimental results shows that the proposed method is comparable with the state-of-the-art feature selection.

Subspace Selection for Nonlinear Feature Extraction Based on Kernel Partial Least Squares

Feature Selection in a Kernel Space

Unsupervised Nonlinear Feature Selection Algorithm Via Kernel Function

Unsupervised Discriminative Feature Selection in a Kernel Space Via L2, 1-Norm Minimization.

Kernel-OPBS Algorithm: A Nonlinear Feature Selection Method for Hyperspectral Imagery

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Adaptive kernel subspace method for speeding up feature extraction

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Nonlinear Sparse Feature Selection Algorithm Via Low Matrix Rank Constraint

Subspace Detection Based on the Combination of Nonlinear Feature Extraction and Feature Selection.

TAKES: a fast method to select features in the kernel space.

MODIFIED KERNEL-BASED NONLINEAR FEATURE EXTRACTION

Feature Selection Embedded Subspace Clustering

Subspace Learning for Unsupervised Feature Selection Via Matrix Factorization.

Nonlinear Joint Unsupervised Feature Selection

Nonnegative Laplacian Embedding Guided Subspace Learning for Unsupervised Feature Selection.

An Efficient Method of Nonlinear Feature Extraction Based on SVM

Discriminative Sparse Subspace Learning and Its Application to Unsupervised Feature Selection

Dual-graph regularized subspace learning based feature selection

Subspace Learning for Feature Selection via Rank Revealing QR Factorization: Unsupervised and Hybrid Approaches with Non-negative Matrix Factorization and Evolutionary Algorithm

Local Discriminative Based Sparse Subspace Learning for Feature Selection