Abstract:Under the imbalanced dataset, the performance of the base-classifier, the computing method of weight of base-classifier and the selection method of the base-classifier have a great impact on the performance of the ensemble classifier. In order to solve above problem to improve the generalization performance of ensemble classifier, a selective ensemble learning algorithm based on under-sampling for imbalanced dataset is proposed. First, the proposed algorithm calculates the number K of under-sampling samples according to the relationship between class sample density. Then, we use the improved K-means clustering algorithm to under-sample the majority class samples and obtain K cluster centers. Then, all cluster centers (or the sample of the nearest cluster center) are regarded as new majority samples to construct a new balanced training subset combine with the minority class?s samples. Repeat those processes to generate multiple training subsets and get multiple base-classifiers. However, with the increasing of iterations, the number of base-classifiers increase, and the similarity among the base-classifiers will also increase. Therefore, it is necessary to select some base-classifier with good classification performance and large difference for ensemble. In the stage of selecting base-classifiers, according to the difference and performance of base-classifiers, we use the idea of maximum correlation and minimum redundancy to select base-classifiers. In the ensemble stage, G-mean or F-mean is selected to evaluate the classification performance of base-classifier for imbalanced dataset. That is to say, it is selected to compute the weight of each base-classifier. And then the weighted voting method is used for ensemble. Finally, the simulation results on the artificial dataset, UCI dataset and KDDCUP dataset show that the algorithm has good generalization performance on imbalanced dataset, especially on the dataset with high imbalance degree.

An Optimally Selective Ensemble Classifier Based on Multimodal Perturbation and Its Application

Multimodal Perturbation and Cluster Pruning Based Selective Ensemble Classifier and Its Iron Industrial Application

Ensemble Classifier Design Based on Perturbation Binary Salp Swarm Algorithm for Classification

Intuitionistic fuzzy kernel-matching pursuit ensemble algorithm based on hybrid selection strategy

Ensemble learning based on random super-reduct and resampling

Selective Ensemble Based on Transformation of Classifiers Used Spca

Genetic Algorithm Based Selective Ensemble with Multiset Representation

A Novel Hierarchical Selective Ensemble Classifier with Bioinformatics Application

Inverse Halftoning Based on Sparse Representation with Boosted Dictionary.

Selective Ensemble Learning Method for Belief-Rule-base Classification System Based on PAES

Optimizing multimodal feature selection using binary reinforced cuckoo search algorithm for improved classification performance

Experimental Study and Comparison of Imbalance Ensemble Classifiers with Dynamic Selection Strategy

Selective Feature Bagging of one-class classifiers for novelty detection in high-dimensional data

Selective Ensemble of Uncertain Extreme Learning Machine for Pattern Classification with Missing Features

Feature selection inspired classifier ensemble reduction.

Proximal SVM ensemble based on feature selection

Classifier Subset Selection Based on Classifier Representation and Clustering Ensemble

An Adaptive Feature Selection Method for Multi-Class Classification.

A Neural Network Selection Approach of Constructing Ensemble Based on CS Algorithm

Optimization of Selective Ensemble for Cost-Sensitive Classification: an Empirical Study

Uncertainty in Selective Bagging: A Dynamic Bi-objective Optimization Model.