Abstract:Feature subset selection problem is an NP hard problem and there is a need for computationally efficient algorithms that find near optimal feature subsets which improve the performance of a classifier. Two major challenges for feature subset selection are high-dimensional data, that is, data with a large number of features and large datasets. Scalability of the feature selection algorithms in terms of accuracy for high dimensional data and the time taken for large datasets are important issues. We propose a consensus clustering based approach to feature selection that addresses these issues. There exist many greedy feature ranking algorithms in the literature that are computationally efficient. Each algorithm assigns a different ranking order to the features. A consensus among these rankings may provide a feature ranking that performs well with respect to time as well as accuracy. The goal of this work is to propose efficient algorithms that work on small as well as large datasets. The contributions of this work include: i. A fast and scalable approach for feature selection Feature ranking based on consensus clustering (FRCC), has been designed using the available feature ranking algorithms from the literature. ii. A parallelizable version of FRCC, namely, Hybrid Feature Selection(HFS) , is proposed to address the feature reduction in large datasets. The implementation results show that FRCC clearly outperforms many recent algorithms in the literature on small as well as large dimensional data sets. HFS has been implemented on datasets with lakhs of instances and dimensionality in hundreds and thousands. HFS proves to be very effective in terms of feature reduction and accuracy in comparison to the results obtained by recent algorithms in the literature.

A Cluster-Based Sequential Feature Selection Algorithm

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A New Unsupervised Feature Selection Algorithm Using Similarity-Based Feature Clustering.

Clustering-based feature subset selection with analysis on the redundancy–complementarity dimension

Cascaded two-stage feature clustering and selection via separability and consistency in fuzzy decision systems

A Modified Sequential Deep Floating Search Algorithm For Feature Selection

A Feature Selection Framework Based on Supervised Data Clustering

FS_SFS: A Novel Feature Selection Method for Support Vector Machines

Heuristic feature selection method for clustering

A Two-Phase Feature Selection Method Using Both Filter and Wrapper

SFE: A Simple, Fast and Efficient Feature Selection Algorithm for High-Dimensional Data

Subspace Clustering by Directly Solving Discriminative K-means

A Contrast Based Feature Selection Algorithm for High-dimensional Data set in Machine Learning

Simultaneous Estimation of Number of Clusters and Feature Sparsity in Clustering High-Dimensional Data

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

Feature ranking based consensus clustering for feature subset selection

Search Space Division Method for Wrapper Feature Selection on High-Dimensional Data Classification

KNCFS: Feature selection for high-dimensional datasets based on improved random multi-subspace learning