Abstract:In classification tasks with large sample sets, the use of a single classifier carries the risk of overfitting. To overcome this issue, an ensemble of classifier models has often been shown to outperform the use of a single “best” model. Given the rich variety of classifier models available, the selection of the high-efficiency classifiers for a given task dataset remains an urgent challenge. However, most of the previous classifier selection methods only focus on the measurement of classification output performance without considering the computational cost. This paper proposes a new ensemble learning method to improve the classification quality for big datasets by using data envelopment analysis. It contains the following two stages: classifier selection and classifier combination. In the first stage, the commonly used classifiers are evaluated on the basis of their performance on resource consumption and classification output performance using the range directional model (RDM); then, the most efficient classifiers are selected. In the second stage, the classifier confusion matrix is evaluated using the data envelopment analysis (DEA) cross-efficiency model. Then, the weight for the classifier combination is determined to ensure that classifiers with higher performance have greater weights based on the cross-efficiency values. Experimental results demonstrate the superiority of the cross-efficiency model over the BCC model and the benchmark voting method in model ensemble. Furthermore, our method has been shown to save more computational resources and yields better results than existing methods.

Dynamic Ensemble Learning for Multi-label Classification

Dual Enhancement for Multi-Label Learning with Missing Labels

A New Ensemble Method for Multi-label Data Stream Classification in Non-stationary Environment

Enhancing Multi-Label Classification Via Dynamic Label-Order Learning

Applying an Ensemble Learning Method for Improving Multi-label Classification Performance

A Self-Ensemble Approach for Partial Multi-Label Learning

ML-FOREST: A Multi-Label Tree Ensemble Method for Multi-Label Classification

INDEPENDENCE REGULARIZED MULTI-LABEL ENSEMBLE

A three-way selective ensemble model for multi-label classification

Ensemble Weak-Label Classification by Maximizing Dependency Between Label and Feature

Partial Multi-Label Learning with Mutual Teaching

An Ensemble Multi-Label Classification Method Using Feature Selection

Discovering Latent Class Labels for Multi-Label Learning

Multi-label Classification: Dealing with Imbalance by Combining Labels

D2S: Dynamic Distribution Supervision for Multi-Label Facial Expression Recognition

Multi-Label Ensemble Based on Variable Pairwise Constraint Projection

Semisupervised Multiple Choice Learning for Ensemble Classification

An Ensemble Model for 2D-Data Classification Based on Classical & Deep Learning Classifier

Ensemble Learning Method for Classification: Integrating Data Envelopment Analysis with Machine Learning

Multi-dimensional Multi-Label Classification: Towards Encompassing Heterogeneous Label Spaces and Multi-Label Annotations

Multi-Label Learning with Emerging New Labels