Abstract:Feature selection has been extensively applied in statistical pattern recognition as a mechanism for cleaning up the set of features that are used to represent data and as a way of improving the performance of classifiers. Four schemes commonly used for feature selection are Exponential Searches, Stochastic Searches, Sequential Searches, and Best Individual Features. The most popular scheme used in text categorization is Best Individual Features as the extremely high dimensionality of text feature spaces render the other three feature selection schemes time prohibitive. This paper proposes five new metrics for selecting Best Individual Features for use in text categorization. Their effectiveness have been empirically tested on two well- known data collections, Reuters-21578 and 20 Newsgroups. Experimental results show that the performance of two of the five new metrics, Bayesian Rule and F-one Value, is not significantly below that of a good traditional text categorization selection metric, Document Frequency. The performance of another two of these five new metrics, Low Loss Dimensionality Reduction and Relative Frequency Difference, is equal to or better than that of conventional good feature selection metrics such as Mutual Information and Chi-square Statistic.

A New Feature Selection Method in Text Categorization

A New Feature Selection Method for Text Categorization

A New Approach of Feature Selection for Text Categorization

An Effective Feature Selection Method For Text Categorization

Feature Selection Method on Imbalanced Text

Comparison and Improvement of Feature Selection Method for Text Categorization

A Feature Selection Method Based on Class Feature Domains for Text Categorization

Study on an Improved Mutual Information for Feature Selection in Chinese Text Categorization

Study on Mutual Information-Based Feature Selection in Text Categorization

Study on Feature Selection Methods in Chinese Text Categorization

A Two-Stage Feature Selection Method for Text Categorization

Application of Feature Selection Method to Text Categorization Based on Feature Contribution Degree

Relative Term-Frequency Based Feature Selection for Text Categorization

Improved Comprehensive Measurement Feature Selection Method for Text Categorization

A Discriminative and Semantic Feature Selection Method for Text Categorization

A Framework of Feature Selection Methods for Text Categorization.

An Enhanced Text Categorization Method Based on Improved Text Frequency Approach and Mutual Information Algorithm

A New Feature Selection Based on Comprehensive Measurement Both in Inter-Category and Intra-Category for Text Categorization

A New Approach To Feature Selection For Text Categorization

New Feature Selection Approach(cdf) for Text Categorization

FIVE NEW FEATURE SELECTION METRICS IN TEXT CATEGORIZATION