Abstract:Imbalanced problem is concerned with the performance of classifiers on the data set with severe class imbalance distribution. Traditional methods are misled by the majority samples to make the incorrect prediction and fail to make full use of minority samples. This paper is motivated to design a novel hybrid ensemble learning strategy named Sample and Feature Selection Hybrid Ensemble Learning (SFSHEL) and combine it with random forest to improve the classification performance of imbalanced data. Specifically, SFSHEL considers cluster-based stratification to undersample the majority samples and adopts sliding windows mechanism to generate a diversity of feature subsets, simultaneously. Then the weights trained through validation are assigned to different base learners and SFSHEL makes the prediction by weighted voting at last. In this manner, SFSHEL could not only guarantee the acceptable performance, but also save computational time. Furthermore, the weighting process makes SFSHEL interpret the importance of each selected feature set, which is important in the real-world scenarios. The contributions of the proposed strategy are: (1) reducing the impact of class imbalance distribution, (2) assigning based learner weights only once after the training process, and (3) generating weights of features to help interpret the importance of clinical features. In practice, the random forest is adopted as the base learner for SFSHEL, so as to build a classifier abbreviated as SFSHEL-RF. The experiments show the average performance of the proposed SFSHEL-RF on a part of KEEL dataset reaches 91.37%, which is comparable to our previous best ECUBoost-RF method and higher than the other eleven methods. On the clinical heart failure datasets, the performance of SFSHEL-RF can stably reach the level of the top three with three indicators. The experimental results on both the standard imbalanced and clinical heart failure datasets validate the effectiveness and stability of SFSHEL-RF.

Grouped Variable Selection Using Area under the ROC with Imbalanced Data

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Regularized receiver operating characteristic-based logistic regression for grouped variable selection with composite criterion

A Descriptive Study of Variable Discretization and Cost-Sensitive Logistic Regression on Imbalanced Credit Data

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Random Forest Variable Importance-based Selection Algorithm in Class Imbalance Problem

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

Selection and combination of biomarkers using ROC method for disease classification and prediction

Efficient Selection of Gaussian Kernel SVM Parameters for Imbalanced Data

An Empirical Study on the Joint Impact of Feature Selection and Data Re-sampling on Imbalance Classification

Predicting class-imbalanced business risk using resampling, regularization, and model ensembling algorithms

Simulation Study of Imbalanced Classification on High-Dimensional Gene Expression Data

Affine combination‐based over‐sampling for imbalanced regression

Self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification

Grouped-sampling technique to deal with unbalance in Raman spectral data modeling

Under-sampling class imbalanced datasets by combining clustering analysis and instance selection

Model selection and estimation in regression with grouped variables

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning

A learning method for the class imbalance problem with medical data sets

Sample and feature selecting based ensemble learning for imbalanced problems

An oversampling FCM-KSMOTE algorithm for imbalanced data classification