Abstract:Text classification has been highlighted as the key process to organize online texts for better communication in the Digital Media Age. Text classification establishes classification rules based on text features, so the accuracy of feature selection is the basis of text classification. Facing fast-increasing Chinese electronic documents in the digital environment, scholars have accumulated quite a few algorithms for the feature selection for the automatic classification of Chinese texts in recent years. However, discussion about how to adapt existing feature selection algorithms for various types of Chinese texts is still inadequate. To address this, this study proposes three improved feature selection algorithms and tests their performance on different types of Chinese texts. These include an enhanced CHI square with mutual information (MI) algorithm, which simultaneously introduces word frequency and term adjustment (CHMI); a term frequency–CHI square (TF–CHI) algorithm, which enhances weight calculation; and a term frequency–inverse document frequency (TF–IDF) algorithm enhanced with the extreme gradient boosting (XGBoost) algorithm, which improves the algorithm’s ability of word filtering (TF–XGBoost). This study randomly chooses 3000 texts from six different categories of the Sogou news corpus to obtain the confusion matrix and evaluate the performance of the new algorithms with precision and the F1-score. Experimental comparisons are conducted on support vector machine (SVM) and naive Bayes (NB) classifiers. The experimental results demonstrate that the feature selection algorithms proposed in this paper improve performance across various news corpora, although the best feature selection schemes for each type of corpus are different. Further studies of the application of the improved feature selection methods in other languages and the improvement in classifiers are suggested.

Chinese Language and Literature Online Resource Classification Algorithm Based on Improved SVM

Sentiment Classification for Chinese Reviews: a Comparison Between SVM and Semantic Approaches

Improving short text classification using public search engines

DEEP WEB DATA SOURCES CLASSIFICATION BASED ON TEXT VSM OF QUERY INTERFACE

Research on Chinese Text Classification Based on WAE and SVM

RESEARCH ON APPLICATION OF SVM IN WEBSITE CLASSIFICATION

SVM Classification:Its Contents and Challenges

A Study of Discriminatory Speech Classification Based on Improved Smote and SVM-RF

Text recognition and classification of english teaching content based on SVM

Adapting Feature Selection Algorithms for the Classification of Chinese Texts

Chinese Text Classification System on Regulatory Information Based on SVM

Construction of English and American Literature Corpus Based on Machine Learning Algorithm

Web Page Classification Based on SVM

Chinese text classification based on character-level CNN and SVM

Design and Exploration of College English Reading, Writing, and Translation Teaching Classroom Based on Machine Learning

Locality Sensitive Hashing Based Service Classification

Implementation of Classification and Recognition Algorithm for Text Information Based on Support Vector Machine

Improvement of Support Vector Machine Algorithm in Big Data Background

Sentiment Text Classification of Customers Reviews on the Web Based on SVM

A simple and efficient classifying algorithm