Abstract:Ensemble pruning aims to achieve a good result in classification using a smaller size of classifiers by finding the optimal sub-ensemble. Diversity and accuracy of classifiers are widely recognized to be two key factors for a successful ensemble. There is a tradeoff between the diversity and the accuracy of classifiers, which makes the ensemble perform the best. Existing ensemble pruning approaches always find the tradeoff using diversity measures or heuristic algorithms separately. Those pruning approaches based on diversity measures cannot exactly find the tradeoff; Those algorithms based on heuristic algorithms are not also to exhaustively search for it extracted from an initial pool of classifiers with a medium-scale or large-scale size. To address the issue, Improved Discrete Artificial Fish swarm algorithm combined with Margin distance minimization for Ensemble Pruning (IDAFMEP) is proposed using a combination of diversity measure and heuristic algorithm. First, the classifiers in a constructed initial pool are pre-pruned using Margin Distance Minimization (MDM), which can downsize the classifiers who perform badly, and markedly alleviate the computational complexity of ensemble pruning. Second, the final ensemble is efficiently achieved from the retaining classifiers after pre-pruning based on MDM using the proposed Improved discrete Artificial Fish Swarm Algorithm (IDAFSA). Experimental results on 29 datasets from the UCI Machine Learning Repository demonstrate that IDAFMEP can achieve better results than the original ensemble and other state-of-the-art pruning approaches, and that its validity and effectiveness. It provides a new research idea for ensemble pruning.

Multilayer Ensemble Pruning Via Novel Multi-sub-swarm Particle Swarm Optimization.

Ensemble One-class Classifiers Based on Hybrid Diversity Generation and Pruning

Combining Weak-Link Co-Evolution Binary Artificial Fish Swarm Algorithm and Complementarity Measure for Ensemble Pruning

Spread Binary Artificial Fish Swarm Algorithm Combined with Double-Fault Measure for Ensemble Pruning

Margin-Based Pareto Ensemble Pruning: an Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles.

Classifier Subset Selection Based on Classifier Representation and Clustering Ensemble

Ensemble Pruning Via Individual Contribution Ordering

Ensemble Pruning: A Submodular Function Maximization Perspective.

Improved Discrete Artificial Fish Swarm Algorithm Combined with Margin Distance Minimization for Ensemble Pruning

A Multi-objective Particle Swarm Optimization for Neural Networks Pruning

Pareto Ensemble Pruning

An optimal pruning algorithm of classifier ensembles: dynamic programming approach

A Multiple Criteria Ensemble Pruning Method for Binary Classification Based on D-S Theory of Evidence

Pruning strategy based bare bones particle swarm optimization

A Novel Bayesian Ensemble Pruning Method

Diversity Regularized Ensemble Pruning.

Multi-objective Evolutionary Ensemble Pruning Guided by Margin Distribution

A Probabilistic Ensemble Pruning Algorithm

A Novel Multiple Classifiers Integration Algorithm with Pruning Function

A K-means-based Multi-subpopulation Particle Swarm Optimization for Neural Network Ensemble

MEPSI: an MDL-Based Ensemble Pruning Approach with Structural Information