Abstract:Text classification (TC) is the task of automatically assigning documents to a fixed number of categories. TC is an important component in many text applications. Many of these applications perform preprocessing. There are different types of text preprocessing, e.g., conversion of uppercase letters into lowercase letters, HTML tag removal, stopword removal, punctuation mark removal, lemmatization, correction of common misspelled words, and reduction of replicated characters. We hypothesize that the application of different combinations of preprocessing methods can improve TC results. Therefore, we performed an extensive and systematic set of TC experiments (and this is our main research contribution) to explore the impact of all possible combinations of five/six basic preprocessing methods on four benchmark text corpora (and not samples of them) using three ML methods and training and test sets. The general conclusion (at least for the datasets verified) is that it is always advisable to perform an extensive and systematic variety of preprocessing methods combined with TC experiments because it contributes to improve TC accuracy. For all the tested datasets, there was always at least one combination of basic preprocessing methods that could be recommended to significantly improve the TC using a BOW representation. For three datasets, stopword removal was the only single preprocessing method that enabled a significant improvement compared to the baseline result using a bag of 1,000-word unigrams. For some of the datasets, there was minimal improvement when we removed HTML tags, performed spelling correction or removed punctuation marks, and reduced replicated characters. However, for the fourth dataset, the stopword removal was not beneficial. Instead, the conversion of uppercase letters into lowercase letters was the only single preprocessing method that demonstrated a significant improvement compared to the baseline result. The best result for this dataset was obtained when we performed spelling correction and conversion into lowercase letters. In general, for all the datasets processed, there was always at least one combination of basic preprocessing methods that could be recommended to improve the accuracy results when using a bag-of-words representation.

Text classification with tournament methods

Email categorization with tournament methods

Improving Quality of Email Categorization with Tournament Methods.

A Technique For Improving The Performance Of Naive Bayes Text Classification

Naive Bayes Based Criminal Text Classification of Unbalanced Classes

Two Odds-Radio-Based Text Classification Algorithms

Classifying Chinese Texts in Two Steps.

N-grams based feature selection and text representation for Chinese Text Classification

A Novel Text Classification Algorithm Based on Naïve Bayes and KL-Divergence

Transferring naive bayes classifiers for text classification

Combining multiple statistical classifiers to improve the accuracy of task classification

Methods of Combining Multiple Classifiers with Different Features and Their Applications to Text-Independent Speaker Identification

Accurate Knn Chinese Text Classification Via Multiple Strategies

Mitigating Boundary Ambiguity and Inherent Bias for Text Classification in the Era of Large Language Models

A Curriculum Learning Approach for Multi-Domain Text Classification Using Keyword Weight Ranking

An Empirical Comparative Study on Two Large-Scale Hierarchical Text Classification Approaches

An Ensemble Learning Strategy for Eligibility Criteria Text Classification for Clinical Trial Recruitment: Algorithm Development and Validation (Preprint)

An Ensemble Learning Strategy for Eligibility Criteria Text Classification for Clinical Trial Recruitment: Algorithm Development and Validation

A Comparative Study on Two Large-Scale Hierarchical Text Classification Tasks' Solutions

The influence of preprocessing on text classification using a bag-of-words representation

A Multiple Classifiers Integration Method Based on Adaptive Weigh Adjusting and it's Application on Text Classification