Abstract:<p>The dynamic ensemble selection of classifiers is an effective approach for processing label-imbalanced data classifications. However, such a technique is prone to overfitting, owing to the lack of regularization methods and the dependence of the aforementioned technique on local geometry. In this study, focusing on binary imbalanced data classification, a novel dynamic ensemble method, namely adaptive ensemble of classifiers with regularization (AER), is proposed, to overcome the stated limitations. The method solves the overfitting problem through implicit regularization. Specifically, it leverages the properties of stochastic gradient descent to obtain the solution with the minimum norm, thereby achieving regularization; furthermore, it interpolates the ensemble weights by exploiting the global geometry of data to further prevent overfitting. According to our theoretical proofs, the seemingly complicated AER paradigm, in addition to its regularization capabilities, can actually reduce the asymptotic time and memory complexities of several other algorithms. We evaluate the proposed AER method on seven benchmark imbalanced datasets from the UCI machine learning repository and one artificially generated GMM-based dataset with five variations. The results show that the proposed algorithm outperforms the major existing algorithms based on multiple metrics in most cases, and two hypothesis tests (McNemar's and Wilcoxon tests) verify the statistical significance further. In addition, the proposed method has other preferred properties such as special advantages in dealing with highly imbalanced data, and it pioneers the research on the regularization for dynamic ensemble methods.</p>

Refine Decision Boundaries of a Statistical Ensemble by Active Learning

An Adaptive Strategy for Active Learning with Smooth Decision Boundary

Beyond Discriminant Patterns: On the Robustness of Decision Rule Ensembles

Learning Distinctive Margin Toward Active Domain Adaptation

A Margin-Maximizing Fine-Grained Ensemble Method

Deep Open Intent Classification with Adaptive Decision Boundary

Experimental Study and Comparison of Imbalance Ensemble Classifiers with Dynamic Selection Strategy

An ensemble learning framework based on group decision making

Neighborhood Guided Smoothed Emphasis for Real Adaboost Ensembles

Boundary Matters: A Bi-Level Active Finetuning Framework

On Outlier Problem Of Statistical Ensemble Learning

Adaptive ensemble of classifiers with regularization for imbalanced data classification

Exploring Representativeness and Informativeness for Active Learning.

(De-)Randomized Smoothing for Decision Stump Ensembles

Adaptive Subspace Optimization Ensemble Method for High-Dimensional Imbalanced Data Classification

Boosting Certified Robustness for Time Series Classification with Efficient Self-Ensemble

A Density-Based Re-ranking Technique for Active Learning for Data Annotations

Born-Again Tree Ensembles

Predicting class-imbalanced business risk using resampling, regularization, and model ensembling algorithms

Re-Benchmarking Pool-Based Active Learning for Binary Classification

A Machine Learning Based Ensemble Method for Automatic Multiclass Classification of Decisions