Abstract:In this paper, we propose a semisupervised feature selection approach that is based on feature clustering and hypothesis margin maximization. The aim is to improve the classification accuracy by choosing the right feature subset and to allow building more interpretable models. Our approach handles the two core aspects of feature selection, i.e., relevance and redundancy, and is divided into three steps. First, the similarity weights between features are represented by a sparse graph where each feature can be reconstructed from the sparse linear combination of the others. Second, features are then hierarchically clustered identifying groups of the most similar ones. Finally, a semisupervised margin-based objective function is optimized to select the most data discriminative feature from within each cluster, hence maximizing relevance while minimizing redundancy among features. Eventually, we empirically validate our proposed approach on multiple well-known UCI benchmark datasets in terms of classification accuracy and representation entropy, where it proved to outperform four other semisupervised and unsupervised methods and competed with two widely used supervised ones.

A New Feature Selection Method for Text Clustering

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Unsupervised Feature Selection with Ordinal Locality.

An Evaluation on Feature Selection for Text Clustering

Feature Selection Method on Imbalanced Text

A comprehensive unsupervised feature selection method of two-stage strategy

Feature selection method based on backward cloud model in text classification

A Novel Feature Selection Approach and Feature Weight Adjustment Technique in Text Classification

Text Stream Clustering Algorithm Based on Adaptive Feature Selection.

A New Approach of Feature Selection for Text Categorization

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

A General Framework of Feature Selection for Text Categorization

Feature Selection with Attributes Clustering by Maximal Information Coefficient

Heuristic feature selection method for clustering

Multitype Features Coselection for Web Document Clustering

A Feature Selection Framework Based on Supervised Data Clustering

An Effective Feature Selection Method For Text Categorization

Toward Optimal Feature Selection in Naive Bayes for Text Categorization

Feature Selection Based on Data Clustering

A Linguistic Feature Based Text Clustering Method.