Abstract:AdaBoost is an excellent committee-based tool for classification. However, its effectiveness and efficiency in multiclass categorization face the challenges from methods based on support vector machine (SVM), neural networks (NN), naive Bayes, and k-nearest neighbor (kNN). This paper uses a novel multi-class AdaBoost algorithm to avoid reducing the multi-class classification problem to multiple two-class classification problems. This novel method is more effective. In addition, it keeps the accuracy advantage of existing AdaBoost. An adaptive group-based kNN method is proposed in this paper to build more accurate weak classifiers and in this way control the number of basis classifiers in an acceptable range. To further enhance the performance, weak classifiers are combined into a strong classifier through a double iterative weighted way and construct an adaptive group-based kNN boosting algorithm (AGkNN-AdaBoost). We implement AGkNN-AdaBoost in a Chinese text categorization system. Experimental results showed that the classification algorithm proposed in this paper has better performance both in precision and recall than many other text categorization methods including traditional AdaBoost. In addition, the processing speed is significantly enhanced than original AdaBoost and many other classic categorization algorithms.

A research on text categorization based on the fusion of K-NN and SVM

MSVM-kNN: Combining SVM and K-Nn for Multi-class Text Classification

A Non-VSM kNN algorithm for text classification

Improved KNN using clustering algorithm

A New Text Categorization Method Based on HMM and SVM

A kNN Text Categorization Algorithm Base on χ~2 Statistic

A Fusion of Multiple Classifiers Approach Based on Reliability Function for Text Categorization.

Improved KNN Text Categorization

Two-level hierarchical combination method for text classification

SVM-KNN Classifier--A New Method of Improving the Accuracy of SVM Classifier

INTEGRATING KNN AND HIERARCHICAL SVM FOR AUTOMATIC TEXT CLASSIFICATION

Dimensionality Reduction With Category Information Fusion And Non-Negative Matrix Factorization For Text Categorization

A Text Categorization Method Based on SVM and Improved K-Means

Fast text categorization based on collaborative work in the semantic and class spaces

Multiclass Boosting With Adaptive Group-Based Knn And Its Application In Text Categorization

An On-line Text Categorization Algorithm Based on Information Fusion:Semantic SVM

An improved ML-kNN approach for multi-label text categorization

An Improved K-Nearest Neighbor Algorithm for Text Categorization

A class-feature-centroid classifier for text categorization

Research on Chinese Text Automatic Categorization Based on VSM

Application of SVM-KNN Combination Improvement Algorithm on Patent Text Classification