Abstract:Text classification has been highlighted as the key process to organize online texts for better communication in the Digital Media Age. Text classification establishes classification rules based on text features, so the accuracy of feature selection is the basis of text classification. Facing fast-increasing Chinese electronic documents in the digital environment, scholars have accumulated quite a few algorithms for the feature selection for the automatic classification of Chinese texts in recent years. However, discussion about how to adapt existing feature selection algorithms for various types of Chinese texts is still inadequate. To address this, this study proposes three improved feature selection algorithms and tests their performance on different types of Chinese texts. These include an enhanced CHI square with mutual information (MI) algorithm, which simultaneously introduces word frequency and term adjustment (CHMI); a term frequency–CHI square (TF–CHI) algorithm, which enhances weight calculation; and a term frequency–inverse document frequency (TF–IDF) algorithm enhanced with the extreme gradient boosting (XGBoost) algorithm, which improves the algorithm’s ability of word filtering (TF–XGBoost). This study randomly chooses 3000 texts from six different categories of the Sogou news corpus to obtain the confusion matrix and evaluate the performance of the new algorithms with precision and the F1-score. Experimental comparisons are conducted on support vector machine (SVM) and naive Bayes (NB) classifiers. The experimental results demonstrate that the feature selection algorithms proposed in this paper improve performance across various news corpora, although the best feature selection schemes for each type of corpus are different. Further studies of the application of the improved feature selection methods in other languages and the improvement in classifiers are suggested.

A heuristic feature selection approach for text categorization by using chaos optimization and genetic algorithm

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

A comprehensive unsupervised feature selection method of two-stage strategy

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

An Effective Feature Selection Method For Text Categorization

A New Approach of Feature Selection for Text Categorization

Learning Effective Features for Chinese Text Categorization

Feature selection by using chaotic cuckoo optimization algorithm with levy flight, opposition-based learning and disruption operator

Toward Optimal Feature Selection in Naive Bayes for Text Categorization

OCFS: optimal orthogonal centroid feature selection for text categorization.

A General Framework of Feature Selection for Text Categorization

Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering

An Evaluation on Feature Selection for Text Clustering

Relative Term-Frequency Based Feature Selection for Text Categorization

Adapting Feature Selection Algorithms for the Classification of Chinese Texts

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A New Feature Selection Method for Text Clustering

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization

A novel quantum grasshopper optimization algorithm for feature selection