Abstract:In recent years, classifier ensemble techniques have drawn the attention of many researchers in the machine learning research community. The ultimate goal of these researches is to improve the accuracy of the ensemble compared to the individual classifiers. In this paper, a novel algorithm for building ensembles called dynamic programming-based ensemble design algorithm (DPED) is introduced and studied in detail. The underlying theory behind DPED is based on cooperative game theory in the first phase and applying a dynamic programming approach in the second phase. The main objective of DPED is to reduce the size of the ensemble while encouraging extra diversity in order to improve the accuracy. The performance of the DPED algorithm is compared empirically with the classical ensemble model and with a well-known algorithm called "the most diverse." The experiments were carried out with 13 datasets from UCI and three ensemble models. Each ensemble model is constructed from 15 different base classifiers. The experimental results demonstrate that DPED outperforms the classical ensembles on all datasets in terms of both accuracy and size of the ensemble. Regarding the comparison with the most diverse algorithm, the number of selected classifiers by DPED across all datasets and all domains is less than or equal to the number selected by the most diverse algorithm. Experiment on blog spam dataset, for instance, shows that DPED provides an accuracy of 96.47 compared to 93.87 obtained by the most diverse using 40% training size. Finally, the experimental results verify the reliability, stability, and effectiveness of the proposed DPED algorithm.

Ensemble Pruning Via Base-Classifier Replacement

A New Metric For Greedy Ensemble Pruning

Pareto Ensemble Pruning

Ensemble Pruning Via Individual Contribution Ordering

Predictive Ensemble Pruning by Expectation Propagation

Margin-Based Pareto Ensemble Pruning: an Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles.

Ensemble Pruning Via Constrained Eigen-Optimization

Ensemble Pruning: A Submodular Function Maximization Perspective.

A Novel Bayesian Ensemble Pruning Method

A Probabilistic Ensemble Pruning Algorithm

Ensemble One-class Classifiers Based on Hybrid Diversity Generation and Pruning

Classifier Subset Selection Based on Classifier Representation and Clustering Ensemble

Hierarchical Bagging Ensemble Pruning Based on the Diversity of Base Learners

Hierachical Bagging Ensemble Pruning Based on Deleting Worst Base Learner

Instance-based Ensemble Pruning for Imbalanced Learning.

Regularization Based Ordering for Ensemble Pruning

An optimal pruning algorithm of classifier ensembles: dynamic programming approach

Spread Binary Artificial Fish Swarm Algorithm Combined with Double-Fault Measure for Ensemble Pruning

Combination Classifier Pruning Method Based on Beam Search

Combining Weak-Link Co-Evolution Binary Artificial Fish Swarm Algorithm and Complementarity Measure for Ensemble Pruning

Diversity Regularized Ensemble Pruning.