Abstract:This paper proposes an ensemble algorithm named of BPSO-Adaboost-KNN to cope with multi-class imbalanced data classification. The main idea of this algorithm is to integrate feature selection and boosting into ensemble. What’s more, we utilize a novel evaluation metric called AUCarea which is especially for multi-class classification. In our model BPSO is employed as the feature selection algorithm in which AUCarea is chosen as the fitness. For classification, we generate a boosting classifier in which KNN is selected as the basic classifier. In order to verify the effectiveness of our method, 19 benchmarks are used in our experiments. The results show that the proposed algorithm improves both the stability and the accuracy of boosting after carrying out feature selection, and the performance of our algorithm is comparable with other state-of-the-art algorithms. In statistical analyses, we apply Bland–Altman analysis to show the consistencies between AUCarea and other popular metrics like average G-mean, average F-value etc. Besides, we use linear regression to find deeper correlation between AUCarea and other metrics in order to show why AUCarea works well in this issue. We also put out a series of statistical studies in order to analyze if there exist significant improvements after feature selection and boosting are employed. At last, the proposed algorithm is applied in oil-bearing of reservoir recognition. The classification precision is up to 99% in oilsk81-oilsk85 well logging data in Jianghan oilfield of China, which is 20% higher than KNN classifier. Particularly, the proposed algorithm has significant superiority when distinguishing the oil layer from other layers.

Combination of PSO and AdaBoost Algorithm and Its Application to Multi-Classification Prediction of Yeast Protein Localization Sites

AdaBoost-based Multi-attribute Classification Technology and Its Application

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Optimization of the aggregation in AdaBoost algorithm by particle swarm optimization and its application in classification problems

Optimization of AdaBoost Algorithm by PSO and Its Application in Translation Initiation Sites Prediction

Multi-class AdaBoost ELM

Boosting The Pls Algorithm For Regressive Modelling

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

Improved Pso_adaboost Ensemble Algorithm For Imbalanced Data

Two-Stage Multi-Class Adaboost for Facial Expression Recognition

Using LogitBoost classifier to predict protein structural classes.

Z-Adaboost: Boosting 2-thresholded weak classifiers for object detection

A novel Multi-Agent Ada-Boost algorithm for predicting protein structural class with the information of protein secondary structure

Fair-AdaBoost: Extending AdaBoost method to achieve fair classification

An Efficient Modified Boosting Method for Solving Classification Problems

Advance and Prospects of AdaBoost Algorithm

BPSO-Adaboost-KNN ensemble learning algorithm for multi-class imbalanced data classification

Boosting: An Ensemble Learning Tool for Compound Classification and QSAR Modeling

Improving Protein-Atp Binding Residues Prediction by Boosting SVMs with Random Under-Sampling

Boosting Bootstrap Fld Subspaces In Classification

Improved boosting algorithm through weighted k-nearest neighbors classifier