Abstract:Many feature selection methods have been proposed and most of them are in the supervised learning paradigm. Recently unsupervised feature selection has attracted a lot of attention especially in bioinformatics and text mining. So far, supervised feature selection and unsupervised feature selection method are studied and developed separately. A subset selected by a supervised feature selection method may not be a good one for unsupervised learning and vice verse. In bioinformatics research, however it is very common to perform clustering and classification iteratively for the same data sets, especially in gene expression analysis, thus it is very desirable to have a feature selection method which works well for both unsupervised learning and supervised learning. In this paper we propose a novel feature selection algorithm through feature clustering. Our algorithm does not need the class label information in the data set and is suitable for both supervised learning and unsupervised learning. Our algorithm groups the features into different clusters based on feature similarity, so that the features in the same clusters are similar to each other. A representative feature is selected from each cluster, thus reduces the feature redundancy. Our feature selection algorithm uses feature similarity for feature redundancy reduction but requires no feature search, works very well for high dimensional data set. We test our algorithm on some biological data sets for both clustering and classification analysis and the results indicates that our FSFC algorithm can significantly reduce the original data sets without scarifying the quality of clustering and classification.

A Feature Selection Framework Based on Supervised Data Clustering

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

Feature Selection Based on Data Clustering

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Feature Selection Using Hierarchical Feature Clustering

A Novel Unsupervised Feature Selection Method for Bioinformatics Data Sets Through Feature Clustering

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

A New Unsupervised Feature Selection Algorithm Using Similarity-Based Feature Clustering.

Feature Selection with Attributes Clustering by Maximal Information Coefficient

A Supervised Feature Selection Algorithm through Minimum Spanning Tree Clustering

Feature Selection in Clustering Problems

Unsupervised Feature Selection for Balanced Clustering

A framework for feature selection in clustering

Unsupervised Feature Selection with Joint Clustering Analysis.

Unsupervised feature selection for multi-cluster data

Heuristic feature selection method for clustering

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

Unsupervised Feature Selection Based on Feature Relevance

A GA-Based Feature Selection for High-Dimensional Data Clustering

Feature Selection for Clustering on High Dimensional Data

Supervised Feature Selection with a Stratified Feature Weighting Method