Abstract:AdaBoost is an efficacious classification algorithm especially in text categorization (TC) tasks. The methodology of setting up a classifier committee and voting on the documents for classification can achieve high categorization precision. However, traditional Vector Space Model can easily lead to the curse of dimensionality and feature sparsity problems; so it affects classification performance seriously. This article proposed a novel classification algorithm called LDABoost based on boosting ideology which uses Latent Dirichlet Allocation (LDA) to modeling the feature space. Instead of using words or phrase, LDABoost use latent topics as the features. In this way, the feature dimension is significantly reduced. Improved Naïve Bayes (NB) is designed as the weaker classifier which keeps the efficiency advantage of classic NB algorithm and has higher precision. Moreover, a two-stage iterative weighted method called Cute Integration in this article is proposed for improving the accuracy by integrating weak classifiers into strong classifier in a more rational way. Mutual Information is used as metrics of weights allocation. The voting information and the categorization decision made by basis classifiers are fully utilized for generating the strong classifier. Experimental results reveals LDABoost making categorization in a low-dimensional space, it has higher accuracy than traditional AdaBoost algorithms and many other classic classification algorithms. Moreover, its runtime consumption is lower than different versions of AdaBoost, TC algorithms based on support vector machine and Neural Networks.

Lda Boost Classification: Boosting by Topics

Multi-LDA hybrid topic model with boosting strategy and its application in text classification

Enhance Adaboost Algorithm By Integrating Lda Topic Model

Multiclass Boosting With Adaptive Group-Based Knn And Its Application In Text Categorization

Multi-class AdaBoost ELM

An Enhanced Adaboost Algorithm With Naive Bayesian Text Categorization Based On A Novel Re-Weighting Strategy

Improved AdaBoost Algorithm Based on Vote Entropy

Modeling Texts in Semantic Space and Ensemble Topic-Models Via Boosting Strategy

An Improved FloatBoost Algorithm for Naïve Bayes Text Classification.

An improved floatboost algorithm for Naïve bayes text classification

Boosting Bootstrap Fld Subspaces In Classification

A Study of AdaBoost with Naive Bayesian Classifiers: Weakness and Improvement.

FloatBoost Learning for Classification.

An Adaptive Boosting Algorithm Based on Weighted Feature Selection and Category Classification Confidence

Two-Stage Multi-Class Adaboost for Facial Expression Recognition

An Improved Boosting Algorithm with Naive Bayesian Classification Based on Multi-Views

Boosting Naive Bayesian Learning

Transfer Learning with Reasonable Boosting Strategy

Defining And Evaluating Classification Algorithm For High-Dimensional Data Based On Latent Topics

Effective Boosting of Naïve Bayesian Classifiers by Local Accuracy Estimation

Multi-Class L(2)-Boost With The Scoring Coding