Abstract:Biomedical data are widely accepted in developing prediction models for identifying a specific tumor, drug discovery and classification of human cancers. However, previous studies usually focused on different classifiers, and overlook the class imbalance problem in real-world biomedical datasets. There are a lack of studies on evaluation of data pre-processing techniques, such as resampling and feature selection, on imbalanced biomedical data learning. The relationship between data pre-processing techniques and the data distributions has never been analysed in previous studies. This article mainly focuses on reviewing and evaluating some popular and recently developed resampling and feature selection methods for class imbalance learning. We analyse the effectiveness of each technique from data distribution perspective. Extensive experiments have been done based on five classifiers, four performance measures, eight learning techniques across twenty real-world datasets. Experimental results show that: (1) resampling and feature selection techniques exhibit better performance using support vector machine (SVM) classifier. However, resampling and Feature Selection techniques perform poorly when using C4.5 decision tree and Linear discriminant analysis classifiers; (2) for datasets with different distributions, techniques such as Random undersampling and Feature Selection perform better than other data pre-processing methods with T Location-Scale distribution when using SVM and KNN (K-nearest neighbours) classifiers. Random oversampling outperforms other methods on Negative Binomial distribution using Random Forest classifier with lower level of imbalance ratio; (3) Feature Selection outperforms other data pre-processing methods in most cases, thus, Feature Selection with SVM classifier is the best choice for imbalanced biomedical data learning.

Survey on Imbalanced Data Mining Methods

Data Mining on Imbalanced Data Sets

A survey of multi-class imbalanced data classification methods

A survey on imbalanced learning: latest research, applications and future directions

Classification Methods on Imbalanced Data: a Survey

How Far Have We Progressed in the Sampling Methods for Imbalanced Data Classification? an Empirical Study

A Survey on Imbalanced Data Learning Method

Review of Classification Methods on Unbalanced Data Sets

A survey of imbalanced pattern classification problems

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Overview of Classification Algorithms for Unbalanced Data

A literature survey on various aspect of class imbalance problem in data mining

Class Imbalance Problem in Data Mining Review

Mining Knowledge from Unbalanced Data: Effect of Class Distribution on SVM Classification

Imbalanced Data Classification:A Survey and Experiments in Medical Domain

Machine Learning-Based Processing of Unbalanced Data Sets for Computer Algorithms

Overview of Imbalanced Data Classification

A Study of Data Pre-processing Techniques for Imbalanced Biomedical Data Classification

A Survey of Methods for Managing the Classification and Solution of Data Imbalance Problem

A broad review on class imbalance learning techniques

An Empirical Study on Preprocessing High-Dimensional Class-Imbalanced Data for Classification