Abstract:With the rapid development of information techniques, the dimensionality of data in many application domains, such as text categorization and bioinformatics, is getting higher and higher. The high-dimensionality data may bring many adverse situations, such as overfitting, poor performance, and low efficiency, to traditional learning algorithms in pattern classification. Feature selection aims at reducing the dimensionality of data and providing discriminative features for pattern learning algorithms. Due to its effectiveness, feature selection is now gaining increasing attentions from a variety of disciplines and currently many efforts have been attempted in this field. In this paper, we propose a new supervised feature selection method to pick important features by using information criteria. Unlike other selection methods, the main characteristic of our method is that it not only takes both maximal relevance to the class labels and minimal redundancy to the selected features into account, but also works like feature clustering in an agglomerative way. To measure the relevance and redundancy of feature exactly, two different information criteria, i.e., mutual information and coefficient of relevance, have been adopted in our method. The performance evaluations on 12 benchmark data sets show that the proposed method can achieve better performance than other popular feature selection methods in most cases.

Feature Selection for Support Vector Machines in Text Categorization

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

A Discriminative and Semantic Feature Selection Method for Text Categorization

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

An Effective Feature Selection Method For Text Categorization

A Method of Feature Selection Based on Word2Vec in Text Categorization

Improving Short Text Classification Through Better Feature Space Selection

A Feature Selection Method Based on Class Feature Domains for Text Categorization

Learning Effective Features for Chinese Text Categorization

Feature Selection for Fast Image Classification with Support Vector Machines

Relative Term-Frequency Based Feature Selection for Text Categorization

Feature subset selection for support vector machines through sensitivity analysis

Feature selection for image categorization

Dimensionality Reduction With Category Information Fusion And Non-Negative Matrix Factorization For Text Categorization

A New Approach of Feature Selection for Text Categorization

A General Framework of Feature Selection for Text Categorization

Study on SVM Compared with the other Text Classification Methods

A New Supervised Feature Selection Method for Pattern Classification.

Research on the Feature Selection Techniques Used in Text Classification.

A Hybrid Feature Selection Approach by Correlation-Based Filters and SVM-RFE