Abstract:Text classification has been highlighted as the key process to organize online texts for better communication in the Digital Media Age. Text classification establishes classification rules based on text features, so the accuracy of feature selection is the basis of text classification. Facing fast-increasing Chinese electronic documents in the digital environment, scholars have accumulated quite a few algorithms for the feature selection for the automatic classification of Chinese texts in recent years. However, discussion about how to adapt existing feature selection algorithms for various types of Chinese texts is still inadequate. To address this, this study proposes three improved feature selection algorithms and tests their performance on different types of Chinese texts. These include an enhanced CHI square with mutual information (MI) algorithm, which simultaneously introduces word frequency and term adjustment (CHMI); a term frequency–CHI square (TF–CHI) algorithm, which enhances weight calculation; and a term frequency–inverse document frequency (TF–IDF) algorithm enhanced with the extreme gradient boosting (XGBoost) algorithm, which improves the algorithm’s ability of word filtering (TF–XGBoost). This study randomly chooses 3000 texts from six different categories of the Sogou news corpus to obtain the confusion matrix and evaluate the performance of the new algorithms with precision and the F1-score. Experimental comparisons are conducted on support vector machine (SVM) and naive Bayes (NB) classifiers. The experimental results demonstrate that the feature selection algorithms proposed in this paper improve performance across various news corpora, although the best feature selection schemes for each type of corpus are different. Further studies of the application of the improved feature selection methods in other languages and the improvement in classifiers are suggested.

A Model-based Feature Optimization Approach to Chinese Language Processing.

A Model-based Feature Optimization Approach to Chinese Language Processing

Improving Short Text Classification Through Better Feature Space Selection

Using an Integrated Feature Set to Generalize and Justify the Chinese-to-English Transferring Rule of the ‘ZHE’ Aspect

Exploiting effective features for chinese sentiment classification

Improve Chinese Aspect Sentiment Quadruplet Prediction via Instruction Learning Based on Large Generate Models

A Feature Model Integrating Basic and Bag-of-Words Binding Features

Adapting Feature Selection Algorithms for the Classification of Chinese Texts

N-grams based feature selection and text representation for Chinese Text Classification

Feature Engineering for Chinese Semantic Role Labeling

Enhancing Chinese Intent Classification by Dynamically Integrating Character Features into Word Embeddings with Ensemble Techniques

Incorporating Language Patterns and Domain Knowledge into Feature-Opinion Extraction.

Effect Research of Aspects Extraction for Chinese Hotel Reviews Based on Machine Learning Method

Aspect-based sentiment analysis with component focusing multi-head co-attention networks

A Progressive Feature Selection Algorithm for Ultra Large Feature Spaces.

Optimization Strategies for Deep Learning Models in Natural Language Processing

Aspect Category Detection Based on Attention Mechanism and Bi-Directional LSTM

Research on Optimization of Natural Language Processing Model Based on Multimodal Deep Learning

Improving Chinese Semantic Role Classification with Hierarchical Feature Selection Strategy.

User- Oriented Chinese Language Model and Its Machine Learning