Abstract:AdaBoost is an efficacious classification algorithm especially in text categorization (TC) tasks. The methodology of setting up a classifier committee and voting on the documents for classification can achieve high categorization precision. However, traditional Vector Space Model can easily lead to the curse of dimensionality and feature sparsity problems; so it affects classification performance seriously. This article proposed a novel classification algorithm called LDABoost based on boosting ideology which uses Latent Dirichlet Allocation (LDA) to modeling the feature space. Instead of using words or phrase, LDABoost use latent topics as the features. In this way, the feature dimension is significantly reduced. Improved Naïve Bayes (NB) is designed as the weaker classifier which keeps the efficiency advantage of classic NB algorithm and has higher precision. Moreover, a two-stage iterative weighted method called Cute Integration in this article is proposed for improving the accuracy by integrating weak classifiers into strong classifier in a more rational way. Mutual Information is used as metrics of weights allocation. The voting information and the categorization decision made by basis classifiers are fully utilized for generating the strong classifier. Experimental results reveals LDABoost making categorization in a low-dimensional space, it has higher accuracy than traditional AdaBoost algorithms and many other classic classification algorithms. Moreover, its runtime consumption is lower than different versions of AdaBoost, TC algorithms based on support vector machine and Neural Networks.

A Tree-liked Hidden Naive Bayes Combination Classifier Based on AdaBoost Method

Improving Classification Performance By Combining Multiple Tan Classifiers

A Method to Boost Naïve Bayesian Classifiers

A Novel Bayes Model: Hidden Naive Bayes

Boosting Naive Bayesian Learning

An Improved Boosting Algorithm with Naive Bayesian Classification Based on Multi-Views

A Double Layer Bayesian Classifier Using Conditional Mutual Information

A NEW BAYESIAN TREE CLASSIFIER AND ITS APPLICATION

A Study of AdaBoost with Naive Bayesian Classifiers: Weakness and Improvement.

Tree Augmented Naïve possibilistic network classifier.

An Enhanced Adaboost Algorithm With Naive Bayesian Text Categorization Based On A Novel Re-Weighting Strategy

Increment Learning Algorithm Based on Bayesian Classifier Integration

Effective Boosting of Naïve Bayesian Classifiers by Local Accuracy Estimation

Algorithm of Partition Based Network Boosting for Imbalanced Data Classification

Lda Boost Classification: Boosting by Topics

Improved AdaBoost Algorithm Based on Vote Entropy

SubTree Augmented Naïve Bayesian classifier based on the fuzzy equivalence partition of attribute variables

Improving Tree Augmented Naive Bayes for Class Probability Estimation

Class dependent feature scaling method via restrictive Bayesian network classifier combination

Tree-Augmented Naive Bayes Ensembles

Improved Weighted Naive Bayes Classification Algorithm Based on Attribute Selection