Abstract:Class imbalance poses a major challenge in different classification tasks, which is a frequently occurring scenario in many real-world applications. Data resampling is considered to be the standard approach to address this issue. The goal of the technique is to balance the class distribution by generating new samples or eliminating samples from the data. A wide variety of sampling techniques have been proposed over the years to tackle this challenging problem. Sampling techniques can also be incorporated into the ensemble learning framework to obtain more generalized prediction performance. Balanced Random Forest (BRF) and SMOTE-Bagging are some of the popular ensemble approaches. In this study, we propose a modification to the BRF classifier to enhance the prediction performance. In the original algorithm, the Random Undersampling (RUS) technique was utilized to balance the bootstrap samples. However, randomly eliminating too many samples from the data leads to significant data loss, resulting in a major decline in performance. We propose to alleviate the scenario by incorporating a novel hybrid sampling approach to balance the uneven class distribution in each bootstrap sub-sample. Our proposed hybrid sampling technique, when incorporated into the framework of the Random Forest classifier, termed as iBRF: improved Balanced Random Forest classifier, achieves better prediction performance than other sampling techniques used in imbalanced classification tasks. Experiments were carried out on 44 imbalanced datasets on which the original BRF classifier produced an average MCC score of 47.03% and an F1 score of 49.09%. Our proposed algorithm outperformed the approach by producing a far better MCC score of 53.04% and an F1 score of 55%. The results obtained signify the superiority of the iBRF algorithm and its potential to be an effective sampling technique in imbalanced learning.

Method for selecting sample weight renew in Adaboost

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Improved AdaBoost algorithm using misclassified samples oriented feature selection and weighted non-negative matrix factorization

A New Method of Training Sample Selection in Text Classification

Improved Adaboost Algorithm for Classification Based on Noise Confidence Degree and Weighted Feature Selection

A Weighted-Resampling Based Transfer Learning Algorithm.

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Sampling + Reweighting: Boosting the Performance of AdaBoost on Imbalanced Datasets

A Method to Boost Naïve Bayesian Classifiers

Two Stages Based Adaptive Sampling Boosting Method

Feature selection based on weight updating and K-L distance

Over-sampling Algorithm Based on Adaboost in Unbalanced Data Set

Improved Boosting Algorithm With Adaptive Filtration

Adaptive Boosting with Fairness-aware Reweighting Technique for Fair Classification

WOTBoost: Weighted Oversampling Technique in Boosting for imbalanced learning

Asymmetric Real Adaboost

Research of the Real Adaboost Algorithm

A Revised AdaBoost Algorithm——AD AdaBoost

iBRF: Improved Balanced Random Forest Classifier

Denying Evolution Resampling: An Improved Method for Feature Selection on Imbalanced Data