Abstract:Stumps, classification trees with only one split at the root node, have been shown by Schapire and Singer to be an effective method for text categorization when embedded in a boosting algorithm as its base classifiers. In their experiments, the splitting point (the partition) of each stump is decided by whether a certain term appears or not in a text document, which is too weak to obtain satisfied accuracy even after they are combined by boosting, and therefore the iteration times needed by boosting is sharply increased as an indicator of low efficiency. To improve these base classifiers, an idea is proposed in this paper to decide the splitting point of each stump by all the terms of a text document. Specifically, it employs the numerical relationship between the similarities of the VSM-vector of text document and the representational VSM-vector of each class as the partition criteria of the base classifiers. Meanwhile, to further facilitate its convergence, the boosting weights assigned to sample documents are introduced to the computation of representational VSM-vectors for possible classes dynamically. Experimental results show that the algorithm is both more efficient for training and more effective than its predecessor for fulfilling text categorization tasks. This trend seems more conspicuous along with the incensement of problem scale.

Using boosting mechanism to refine the threshold of VSM-based similarity in text classification

A Technique For Improving The Performance Of Naive Bayes Text Classification

A Study of Discriminatory Speech Classification Based on Improved Smote and SVM-RF

Improved Stumps Combined by Boosting for Text Categorization

An Improved Text Categorization Algorithm Based on VSM

A feature selection method based on synonym merging in text classification system

Hybrid SVM algorithm oriented to classifying imbalanced datasets

A New Text Categorization Method Based on HMM and SVM

Research on Chinese Text Automatic Categorization Based on VSM

Support Vector Boosting Machine (SVBM): Enhancing Classification Performance with AdaBoost and Residual Connections

Chinese Text Classification Based on the BVB Model

Study on SVM Compared with the other Text Classification Methods

A Method to Boost Support Vector Machines

The Application of Semantic Similarity in Text Classification

Improved text classification methods based on weighted adjustments

WordNet-based Concept Vector Space Model for Text Classification

Improving text similarity measurement by critical sentence vector model

A Chinese Short Text Classification Method Based on TF-IDF and Gradient Boosting Decision Tree

Semantic Similarity Metric and Its Application in Text Classification

A More Efficient Preprocessing Method for Support Vector Classification

A Method of Feature Selection Based on Word2Vec in Text Categorization