Abstract:Feature subset selection problem is an NP hard problem and there is a need for computationally efficient algorithms that find near optimal feature subsets which improve the performance of a classifier. Two major challenges for feature subset selection are high-dimensional data, that is, data with a large number of features and large datasets. Scalability of the feature selection algorithms in terms of accuracy for high dimensional data and the time taken for large datasets are important issues. We propose a consensus clustering based approach to feature selection that addresses these issues. There exist many greedy feature ranking algorithms in the literature that are computationally efficient. Each algorithm assigns a different ranking order to the features. A consensus among these rankings may provide a feature ranking that performs well with respect to time as well as accuracy. The goal of this work is to propose efficient algorithms that work on small as well as large datasets. The contributions of this work include: i. A fast and scalable approach for feature selection Feature ranking based on consensus clustering (FRCC), has been designed using the available feature ranking algorithms from the literature. ii. A parallelizable version of FRCC, namely, Hybrid Feature Selection(HFS) , is proposed to address the feature reduction in large datasets. The implementation results show that FRCC clearly outperforms many recent algorithms in the literature on small as well as large dimensional data sets. HFS has been implemented on datasets with lakhs of instances and dimensionality in hundreds and thousands. HFS proves to be very effective in terms of feature reduction and accuracy in comparison to the results obtained by recent algorithms in the literature.

Feature Selection using ReliefF Algorithm

Relief-Based Feature Selection: Introduction and Review

An Unsupervised Feature Selection Method Based on Improved ReliefF and Bisecting K-means

An adaption of relief for redundant feature elimination

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature Selection for Cross-Scene Hyperspectral Image Classification Using Cross-Domain ReliefF

Feature Selection for Cross-Scene Hyperspectral Image Classification Using Cross-Domain I-ReliefF

Feature selection based on dataset variance optimization using Hybrid Sine Cosine – Firehawk Algorithm (HSCFHA)

Feature ranking based consensus clustering for feature subset selection

Feature selection based on run covering

SFE: A Simple, Fast and Efficient Feature Selection Algorithm for High-Dimensional Data

Research and Application of Data Mining Feature Selection Based on Relief Algorithm

Empirical Evaluation of the Performance of Feature Selection Approaches on Random Forest

ReliefF-based Multi-label Feature Selection

Feature Selection Method Based on High-Resolution Remote Sensing Images and the Effect of Sensitive Features on Classification Accuracy

Fibonacci and k-Subsecting Recursive Feature Elimination

Gene selection algorithm by combining reliefF and mRMR

ReliefE: feature ranking in high-dimensional spaces via manifold embeddings

Benchmarking Relief-Based Feature Selection Methods for Bioinformatics Data Mining

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

A feature selection approach based on NSGA-II with ReliefF