Abstract:Text processing tasks commonly grapple with the challenge of high dimensionality. One of the most effective solutions to this challenge is to preprocess text data through feature selection methods. Feature selection can select the most advantageous features for subsequent operations (e.g., classification) from the native feature space of the text. This process effectively trims the feature space's dimensionality, enhancing subsequent operations' efficiency and accuracy. This paper proposes a straightforward and efficient filter feature selection method based on document-term matrix unitization (DTMU) for text processing. Diverging from previous filter feature selection methods that concentrate on scoring criteria definition, our method achieves more optimal feature selection by unitizing each column of the document-term matrix. This approach mitigates feature-to-feature influence and reinforces the role of the weighting proportion within the features. Subsequently, our scoring criterion subtracts the sum of weights for negative samples from positive samples and takes the absolute value. We conduct numerical experiments to compare DTMU with four advanced filter feature selection methods: max–min ratio metric, proportional rough feature selector, least loss, and relative discrimination criterion, along with two classical filter feature selection methods: Chi-square and information gain. The experiments are performed on four ten-thousand-dimensional feature space datasets: book , dvd , music , movie and two thousand-dimensional feature space datasets: imdb , amazon_cells , sourced from Amazon product reviews and movie reviews. Experimental findings demonstrate that DTMU selects more advantageous features for subsequent operations and achieves a higher dimensionality reduction rate than those of the other six methods used for comparison. Moreover, DTMU exhibits robust generalization capabilities across various classifiers and dimensional datasets. Notably, the average CPU time for a single run of DTMU is measured at 1.455 s.

A Comparative Study on Feature Window Selection in Text Filtering

Improving Short Text Classification Through Better Feature Space Selection

Feature Selection Method on Imbalanced Text

A comprehensive unsupervised feature selection method of two-stage strategy

Efficient Method for Feature Selection in Text Classification

Feature Selection Based on Class Distribution Difference and VPRS for Text Classification

Text Clustering Using Vsm with Feature Clusters

Text Feature Word Selection Based on Relationship Between Words

A Comparative Study of Feature Selection for SVM in Video Text Detection

A New Feature Selection Method for Text Classification Based on Independent Feature Space Search

Text Feature Description Based on Word Co-Occurrence

A Survey for Study of Feature Selection Algorithms

A Study On Feature Weighting In Chinese Text Categorization

Relative Term-Frequency Based Feature Selection for Text Categorization

Study on Web Text Feature Selection Based on Rough Set.

A Method of Feature Selection Based on Word2Vec in Text Categorization

Text Feature Selection Methods Based on Word Vector

Research on the Feature Selection Techniques Used in Text Classification.

A simple and efficient filter feature selection method via document-term matrix unitization

Garbage text classification filtering method Based on VSM

Two-step Based Feature Selection Method for Filtering Redundant Information