Abstract:Text categorization is an important research area in many Information Retrieval (IR) applications. To save the storage space and computation time in text categorization, efficient and effective algorithms for reducing the data before analysis are highly desired. Traditional techniques for this purpose can generally be classified into feature extraction and feature selection. Because of efficiency, the latter is more suitable for text data such as web documents. However, many popular feature selection techniques such as Information Gain (IG) andχ2-test (CHI) are all greedy in nature and thus may not be optimal according to some criterion. Moreover, the performance of these greedy methods may be deteriorated when the reserved data dimension is extremely low. In this paper, we propose an efficient optimal feature selection algorithm by optimizing the objective function of Orthogonal Centroid (OC) subspace learning algorithm in a discrete solution space, called Orthogonal Centroid Feature Selection (OCFS). Experiments on 20 Newsgroups (20NG), Reuters Corpus Volume 1 (RCV1) and Open Directory Project (ODP) data show that OCFS is consistently better than IG and CHI with smaller computation time especially when the reduced dimension is extremely small.

A New Approach of Feature Selection for Text Categorization

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Relative Term-Frequency Based Feature Selection for Text Categorization

An Effective Feature Selection Method For Text Categorization

Feature Selection Method on Imbalanced Text

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

A General Framework of Feature Selection for Text Categorization

A comprehensive unsupervised feature selection method of two-stage strategy

Select Strong Information Features to Improve Text Categorization Effectiveness

Feature selection method based on backward cloud model in text classification

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Toward Optimal Feature Selection in Naive Bayes for Text Categorization

Learning Effective Features for Chinese Text Categorization

An Evaluation on Feature Selection for Text Clustering

A Study On Feature Weighting In Chinese Text Categorization

An Approximate Markov Blanket Feature Selection Algorithm

A New Feature Selection Method for Text Clustering

A High Performance Two-Class Chinese Text Categorization Method

An Efficient Feature Selection Method Using Named Entity Recognition for Chinese Text Categorization

Feature Selection for Support Vector Machines in Text Categorization

OCFS: optimal orthogonal centroid feature selection for text categorization.