Abstract:<p>Text classification (TC) is an essential task of natural language processing (NLP). In order to improve the performance of TC, term weighting is often used to obtain effective text representation by assigning appropriate weights to each term. A term weighting scheme is generally composed of term frequency factor, collection frequency factor and normalization factor. The normalization factor is commonly used as an optional factor to offset the influence of document length. Through the investigation of the existing term weighting schemes, we found that most of them focus on finding a more effective collection frequency factor, but rarely pay attention to finding a new term frequency factor. In this paper, we first proposed a new term frequency factor called modified term frequency (MTF). Different from the normalization factor, MTF directly modifies the raw term frequency based on the length information of all training documents. Then we proposed a new term weighting scheme by combining MTF with an existing collection frequency factor called modified distinguishing feature selector (MDFS). We denoted our scheme by MTF-MDFS (MDFS-based MTF). Extensive experimental results on 19 benchmark text datasets and 6 real-world text datasets show that our proposed MTF and MTF-MDFS are all much better than their state-of-the-art competitors in terms of the classification accuracy and the weighted average of <span class="math"><math>F1</math></span> of widely used base classifiers, such as MNB, SVM and LR.</p>

Improved text classification methods based on weighted adjustments

A Technique For Improving The Performance Of Naive Bayes Text Classification

An improved supervised term weighting scheme for text representation and classification

Improving Short Text Classification Through Better Feature Space Selection

Improving short text classification using public search engines

A Novel Feature Selection Approach and Feature Weight Adjustment Technique in Text Classification

Chinese Text Categorization Based On The Binary Weighting Model With Non-Binary Smoothing

Using modified term frequency to improve term weighting for text classification

A Multiple Classifiers Integration Method Based on Adaptive Weigh Adjusting and it's Application on Text Classification

IMPROVING MULTI-LABEL TEXT CLASSIFICATION USING WEIGHTED INFORMATION GAIN AND CO-TRAINED MULTINOMIAL NAÏVE BAYES CLASSIFIER

Supervised Contrastive Learning with Term Weighting for Improving Chinese Text Classification

Modified DFS-based term weighting scheme for text classification

Text classification based on ensemble extreme learning machine

A Study of Discriminatory Speech Classification Based on Improved Smote and SVM-RF

A Novel Text Classification Algorithm Based on Naïve Bayes and KL-Divergence

A Weighted Method to Improve the Centroid-based Classifier

CWC: A Clustering-Based Feature Weighting Approach for Text Classification

Research on dynamic self-adaptive term weighting for multi-class text classification algorithm

A Method for Chinese Text Classification Based on Three-Dimensional Vector Space Model

Several alternative term weighting methods for text representation and classification

Chinese News Text Classification Based on Machine Learning Algorithm