Abstract:For text data, feature dimension reduction is a very significant and important work for simplifying document representation and enhancing computation of learning algorithm. There are usually two main dimension reduction strategies, feature extraction and feature selection. Feature extraction is to create new features to represent documents, whereas feature selection will return a subset of words as features. Comparing two strategies, feature extraction has powerful capacity in reducing dimensionality, but it will lost intuitive semantic for documents. Feature selection has perfect interpretability for text contents, and specially is significant for text dimension reduction, but it is still a difficult work to design a suitable measure for feature evaluation. In this paper we present a new feature selection method called class subspace feature selection (CSFS) method. We utilize PCA feature extraction method to capture lower dimensional class subspaces, and then base on the subspaces to choose the most relevant features to the subspaces. The feature words chosen by our method can approximate the class subspace which has lower dimensionality and also owns intuitive semantic understanding for the class. The experimental results on three text data sets show the effectiveness of our proposal feature selection method.

A Survey On Dimension Reduction Techniques In Text Classification

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Review of Feature Dimension Reduction in Text Classification

Improving Short Text Classification Through Better Feature Space Selection

Feature reduction methods for text classification

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

Feature selection method based on category discriminability

A Brief Survey of Dimension Reduction

Survey of Dimension Reduction Methods in High-dimensional Indexing Schemes

Method of Feature Reduction in Chinese Text Classification Based on Semantics

Text Feature Selection Based on Class Subspace

A novel approach for dimension reduction in text classification base on incomplete information system

Real-valued Multivariate Dimension Reduction: A Survey

Feature Dimension Reduction Short Text Clustering Combined with Semantic and Statistics

Dimensionality Reduction With Category Information Fusion And Non-Negative Matrix Factorization For Text Categorization

Chinese Text Feature Dimension Reduction Based on Semantics.

Recent Advances In Supervised Dimension Reduction: A Survey

Feature dimensionality reduction: a review

Study on Feature Selection of Text Classification in Cross Cover Algorithm

Effect analysis of dimension reduction on support vector machines

New Feature Selection Approach(cdf) for Text Categorization