ELM: a novel ensemble learning method for multi-target regression and multi-label classification problems

Yuxuan Wu,Guikai Guo,Huanhuan Gao
DOI: https://doi.org/10.1007/s10489-024-05570-3
IF: 5.3
2024-06-13
Applied Intelligence
Abstract:In this paper, a new Ensemble Learning Method (ELM) is proposed to deal with multi-target regression and multi-label classification problems. In ELM, the output of each regressor or classifier unit is ensembled to the final multi-target regression or multi-label classification stage by utilizing the threshold strategy. In the final learning stage, a sorted-by-score scheme is specially tailored to generate the regression or classification results. The proposed method is numerically implemented and applied to twenty-nine benchmark data-sets. The average relative root mean squared error is employed to quantify the accuracy of multi-target regression methods. Meanwhile, metrics such as the hamming loss, the macro-precision, the macro-recall, the macro-F1, the micro-precision, and the micro-F1 are utilized to evaluate multi-label classification methods. Furthermore, the Bonferroni-Dunn post-hoc test is employed to illustrate the relative performance of existing methods. Overall, the corresponding regression or classification results show that the proposed ELM generally quantitatively outperforms the other nineteen existing multi-target regression or multi-label classification methods.
computer science, artificial intelligence
What problem does this paper attempt to address?