Abstract:<p>The dynamic ensemble selection of classifiers is an effective approach for processing label-imbalanced data classifications. However, such a technique is prone to overfitting, owing to the lack of regularization methods and the dependence of the aforementioned technique on local geometry. In this study, focusing on binary imbalanced data classification, a novel dynamic ensemble method, namely adaptive ensemble of classifiers with regularization (AER), is proposed, to overcome the stated limitations. The method solves the overfitting problem through implicit regularization. Specifically, it leverages the properties of stochastic gradient descent to obtain the solution with the minimum norm, thereby achieving regularization; furthermore, it interpolates the ensemble weights by exploiting the global geometry of data to further prevent overfitting. According to our theoretical proofs, the seemingly complicated AER paradigm, in addition to its regularization capabilities, can actually reduce the asymptotic time and memory complexities of several other algorithms. We evaluate the proposed AER method on seven benchmark imbalanced datasets from the UCI machine learning repository and one artificially generated GMM-based dataset with five variations. The results show that the proposed algorithm outperforms the major existing algorithms based on multiple metrics in most cases, and two hypothesis tests (McNemar's and Wilcoxon tests) verify the statistical significance further. In addition, the proposed method has other preferred properties such as special advantages in dealing with highly imbalanced data, and it pioneers the research on the regularization for dynamic ensemble methods.</p>

Ensemble Methods For Class Imbalance Learning

A Novel Ensemble Method for Classifying Imbalanced Data

Ensemble Methods: Foundations and Algorithms

Self-paced Ensemble for Highly Imbalanced Massive Data Classification

Class-Imbalanced Deep Learning via a Class-Balanced Ensemble

Handling Inter-class and Intra-class Imbalance in Class-imbalanced Learning

When Semi-supervised Learning Meets Ensemble Learning

Impact of class imbalance ratio on ensemble methods for imbalance problem: A new perspective

Class Imbalance Problem: A Wrapper-Based Approach using Under-Sampling with Ensemble Learning

Rethinking Class Imbalance in Machine Learning

Exploratory Undersampling for Class-Imbalance Learning

Experimental Study and Comparison of Imbalance Ensemble Classifiers with Dynamic Selection Strategy

Ensemble Learning through Diversity Management: Theory, Algorithms, and Applications

Comparison of Ensemble Models as Solutions for Imbalanced Class Classification of Datasets

Ensembling over Classifiers: a Bias-Variance Perspective

Improving imbalance classification via ensemble learning based on two-stage learning

A hybrid data-level ensemble to enable learning from highly imbalanced dataset

Adaptive ensemble of classifiers with regularization for imbalanced data classification

Ensemble learning: A survey

Graph-Based Class-Imbalance Learning With Label Enhancement

A new classifier for imbalanced data with iterative learning process and ensemble operating process