Abstract:In classification tasks with large sample sets, the use of a single classifier carries the risk of overfitting. To overcome this issue, an ensemble of classifier models has often been shown to outperform the use of a single “best” model. Given the rich variety of classifier models available, the selection of the high-efficiency classifiers for a given task dataset remains an urgent challenge. However, most of the previous classifier selection methods only focus on the measurement of classification output performance without considering the computational cost. This paper proposes a new ensemble learning method to improve the classification quality for big datasets by using data envelopment analysis. It contains the following two stages: classifier selection and classifier combination. In the first stage, the commonly used classifiers are evaluated on the basis of their performance on resource consumption and classification output performance using the range directional model (RDM); then, the most efficient classifiers are selected. In the second stage, the classifier confusion matrix is evaluated using the data envelopment analysis (DEA) cross-efficiency model. Then, the weight for the classifier combination is determined to ensure that classifiers with higher performance have greater weights based on the cross-efficiency values. Experimental results demonstrate the superiority of the cross-efficiency model over the BCC model and the benchmark voting method in model ensemble. Furthermore, our method has been shown to save more computational resources and yields better results than existing methods.

Study of Ensemble Algorithm and Its Application

Ensemble Methods: Foundations and Algorithms

A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects

Ensemble Transfer Learning Algorithm

A New Rotation Forest Ensemble Algorithm

A Survey of Selective Ensemble Learning Algorithms

Ensemble Algorithm Of Neural Networks And Its Application

A STUDY ON SOFTWARE RELIABILITY PREDICTION BASED ON ENSEMBLE NEURAL NETWORK

A New Ensemble Feature Selection and Its Application to Pattern Classification

A Comparison of Ensemble Methods in Financial Market Prediction.

Meta-learning Based Classifier Ensemble Strategy and Its Application

Improvement Classification Performance by the Support Vector Machine Ensemble

Ensemble Learning Based Classification Algorithm Recommendation

Ensemble Method for Classification of High-Dimensional Data.

Improving Deep Neural Network Ensembles Using Reconstruction Error

A Neural Network Selection Approach of Constructing Ensemble Based on CS Algorithm

Reranking For Stacking Ensemble Learning

Ensemble Learning Method for Classification: Integrating Data Envelopment Analysis with Machine Learning

Feature selection inspired classifier ensemble reduction.

A Double Penalty Model for Ensemble Learning

Experimental Study and Comparison of Imbalance Ensemble Classifiers with Dynamic Selection Strategy