Abstract:In Dynamic Ensemble Selection (DES) techniques, only the most competent classifiers are selected to classify a given query sample. Hence, the key issue in DES is how to estimate the competence of each classifier in a pool to select the most competent ones. In order to deal with this issue, we proposed a novel dynamic ensemble selection framework using meta-learning, called META-DES. The framework is divided into three steps. In the first step, the pool of classifiers is generated from the training data. In the second phase the meta-features are computed using the training data and used to train a meta-classifier that is able to predict whether or not a base classifier from the pool is competent enough to classify an input instance. In this paper, we propose improvements to the training and generalization phase of the META-DES framework. In the training phase, we evaluate four different algorithms for the training of the meta-classifier. For the generalization phase, three combination approaches are evaluated: Dynamic selection, where only the classifiers that attain a certain competence level are selected; Dynamic weighting, where the meta-classifier estimates the competence of each classifier in the pool, and the outputs of all classifiers in the pool are weighted based on their level of competence; and a hybrid approach, in which first an ensemble with the most competent classifiers is selected, after which the weights of the selected classifiers are estimated in order to be used in a weighted majority voting scheme. Experiments are carried out on 30 classification datasets. Experimental results demonstrate that the changes proposed in this paper significantly improve the recognition accuracy of the system in several datasets.

DES-AS: Dynamic Ensemble Selection Based on Algorithm Shapley

A distance-based weighting framework for boosting the performance of dynamic ensemble selection

A post-selection algorithm for improving dynamic ensemble selection methods

Sorting-Based Dynamic Classifier Ensemble Selection

Dynamic ensemble selection methods for heterogeneous data mining

Integration of an Improved Dynamic Ensemble Selection Approach to Enhance One-Vs-one Scheme.

META-DES.H: a dynamic ensemble selection technique using meta-learning and a dynamic weighting approach

Exploring the Effectiveness of Dynamic Ensemble Selection in the One-Versus-one Scheme

A novel dynamic ensemble selection classifier for an imbalanced data set: An application for credit risk assessment

A DEEP analysis of the META-DES framework for dynamic selection of ensemble of classifiers

Experimental Study and Comparison of Imbalance Ensemble Classifiers with Dynamic Selection Strategy

Dynamic Ensemble Selection for Imbalanced Data Streams with Concept Drift.

Study of Ensemble Algorithm and Its Application

Integration of Classifier Diversity Measures for Feature Selection-Based Classifier Ensemble Reduction.

An Ensemble Classifier Based on Attribute Selection and Diversity Measure

A multi-surrogate-assisted dual-layer ensemble feature selection algorithm

Ensemble Learning Method for Classification: Integrating Data Envelopment Analysis with Machine Learning

Shapley Ensemble Adversarial Attack

Adaptive Semi-Supervised Classifier Ensemble for High Dimensional Data Classification

Analyzing different prototype selection techniques for dynamic classifier and ensemble selection

Towards Data Valuation via Asymmetric Data Shapley