Abstract:The diversity and the accuracy are two important ingredients for ensemble generalization error in an ensemble classifiers system. Nevertheless enhancing the diversity is at the expense of decreasing the accuracy of classifiers, thus balancing the diversity and the accuracy is crucial for constructing a good ensemble method. In the paper, a new ensemble method is proposed that selecting classifiers to ensemble via the transformation of individual classifiers based on diversity and accuracy. In the proposed method, the transformation of classifiers is made to produce new individual classifiers based on original classifiers and the true labels, in order to enhance diversity of an ensemble. The transformation approach is similar to principal component analysis (PCA), but it is essentially different between them that the proposed method employs the true labels to construct the covariance matrix rather than the mean of samples in PCA. Then a selecting rule is constructed based on two rules of measuring the classification performance. By the selecting rule, some available new classifiers are selected to ensemble in order to ensure the accuracy of the ensemble with selected classifiers. In other words, some individuals with poor or same performance are eliminated. Particularly, a new classifier produced by the transformation is equivalent to a linear combination of original classifiers, which indicates that the proposed method enhances the diversity by different transformations instead of constructing different training subsets. The experimental results illustrate that the proposed method obtains the better performance than other methods, and the kappa-error diagrams also illustrate that the proposed method enhances the diversity compared against other methods.

New selective ensemble learning method for decision tree

Clustering Ensemble with High Diversity Based on Adding Artificial Data

Selective Ensemble Of Decision Trees

Structural Diversity for Decision Tree Ensemble Learning

Selective Ensemble Based on Transformation of Classifiers Used Spca

Interpretability Diversity for Decision-Tree-Initialized Dendritic Neuron Model Ensemble

New Algorithm for Selective Clustering Ensemble

An Ensemble Classifier Based on Attribute Selection and Diversity Measure

Resampling-based Selective Clustering Ensembles

Maximizing tree diversity by building complete-random decision trees

A Survey of Selective Ensemble Learning Algorithms

MTForest: Ensemble Decision Trees based on Multi-Task Learning

Ensemble Algorithms With Diversity Measures For Credit Scoring

Novel Selective Support Vector Machine Ensemble Learning Algorithm

Application of adaptive ensemble algorithm based on correctness and diversity

Integration of Classifier Diversity Measures for Feature Selection-Based Classifier Ensemble Reduction.

An Efficient Clustering Ensemble Selection Algorithm

Bagging-Based Selective Clusterer Ensemble

Using dual evolutionary search to construct decision tree based ensemble classifier

Variable Randomness in Decision Tree Ensembles

Classifier Subset Selection Based on Classifier Representation and Clustering Ensemble