Abstract:Text classification has been highlighted as the key process to organize online texts for better communication in the Digital Media Age. Text classification establishes classification rules based on text features, so the accuracy of feature selection is the basis of text classification. Facing fast-increasing Chinese electronic documents in the digital environment, scholars have accumulated quite a few algorithms for the feature selection for the automatic classification of Chinese texts in recent years. However, discussion about how to adapt existing feature selection algorithms for various types of Chinese texts is still inadequate. To address this, this study proposes three improved feature selection algorithms and tests their performance on different types of Chinese texts. These include an enhanced CHI square with mutual information (MI) algorithm, which simultaneously introduces word frequency and term adjustment (CHMI); a term frequency–CHI square (TF–CHI) algorithm, which enhances weight calculation; and a term frequency–inverse document frequency (TF–IDF) algorithm enhanced with the extreme gradient boosting (XGBoost) algorithm, which improves the algorithm’s ability of word filtering (TF–XGBoost). This study randomly chooses 3000 texts from six different categories of the Sogou news corpus to obtain the confusion matrix and evaluate the performance of the new algorithms with precision and the F1-score. Experimental comparisons are conducted on support vector machine (SVM) and naive Bayes (NB) classifiers. The experimental results demonstrate that the feature selection algorithms proposed in this paper improve performance across various news corpora, although the best feature selection schemes for each type of corpus are different. Further studies of the application of the improved feature selection methods in other languages and the improvement in classifiers are suggested.

An Effective Dimension Reduction Approach to Chinese Document Classification Using Genetic Algorithm.

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Improving Short Text Classification Through Better Feature Space Selection

Chinese Document Categorization without Dictionary Support and Segmentation Processing

Chinese Documents Classification Based on N-Grams

Design and simulation of a document clustering algorithm based on genetic algorithm

Chinese Documents Categorization Based on N-gram Information

Adaptive encoding-based evolutionary approach for Chinese document clustering

A document classification approach by GA feature extraction based corner classification neural network

Fusion of effective dimension reduction and discriminative dictionary learning for high-dimensional classification

Application of Genetic Algorithm in Document Clustering

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A METHOD OF HIERARCHICAL DOCUMENT AUTOMATIC CLASSIFICATION IN E-RESEARCH

Adapting Feature Selection Algorithms for the Classification of Chinese Texts

A VECTOR SPACE MODEL BASED DOCUMENT CLASSIFICATION SYSTEM [J]

Eliminating High-Degree Biased Character Bigrams for Dimensionality Reduction in Chinese Text Categorization

A Method for Chinese Text Classification Based on Three-Dimensional Vector Space Model

A hybrid dimension reduction algorithm on ReliefF and APSO

Feature Selection of Face Recognition Based on Genetic Algorithm

Learning Effective Features for Chinese Text Categorization