Abstract:Background Data discretization is an important preprocessing step in data mining for the transfer of continuous feature values to discrete ones, which allows some specific data mining algorithms to construct more effective models and facilitates the data mining process. Because many medical domain datasets are class imbalanced, data resampling methods, including oversampling, undersampling, and hybrid sampling methods, have been widely applied to rebalance the training set, facilitating effective differentiation between majority and minority classes. Objective Herein, we examine the effect of incorporating both data discretization and data resampling as steps in the analytical process on the classifier performance for class-imbalanced medical datasets. The order in which these two steps are carried out is compared in the experiments. Methods Two experimental studies were conducted, one based on 11 two-class imbalanced medical datasets and the other using 3 multiclass imbalanced medical datasets. In addition, the two discretization algorithms employed are ChiMerge and minimum description length principle (MDLP). On the other hand, the data resampling algorithms chosen for performance comparison are Tomek links undersampling, synthetic minority oversampling technique (SMOTE) oversampling, and SMOTE–Tomek hybrid sampling algorithms. Moreover, the support vector machine (SVM), C4.5 decision tree, and random forest (RF) techniques were used to examine the classification performances of the different approaches. Results The results show that on average, the combination approaches can allow the classifiers to provide higher area under the ROC curve (AUC) rates than the best baseline approach at approximately 0.8%–3.5% and 0.9%–2.5% for twoclass and multiclass imbalanced medical datasets, respectively. Particularly, the optimal results for two-class imbalanced datasets are obtained by performing the MDLP method first for data discretization and SMOTE second for oversampling, providing the highest AUC rate and requiring the least computational cost. For multiclass imbalanced datasets, performing SMOTE or SMOTE–Tomek first for data resampling and ChiMerge second for data discretization offers the best performances. Conclusions Classifiers with oversampling can provide better performances than the baseline method without oversampling. In contrast, performing data discretization does not necessarily make the classifiers outperform the baselines. On average, the combination approaches have potential to allow the classifiers to provide higher AUC rates than the best baseline approach.

Handling imbalanced medical datasets: review of a decade of research

A review on over-sampling techniques in classification of multi-class imbalanced datasets: insights for medical problems

Imbalanced Data Classification:A Survey and Experiments in Medical Domain

Addressing Binary Classification over Class Imbalanced Clinical Datasets Using Computationally Intelligent Techniques

A Study of Data Pre-processing Techniques for Imbalanced Biomedical Data Classification

Overlap-Based Undersampling Method for Classification of Imbalanced Medical Datasets

Processing imbalanced medical data at the data level with assisted-reproduction data as an example

Tackling class imbalance in computer vision: a contemporary review

Cost-sensitive learning for imbalanced medical data: a review

Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance

A broad review on class imbalance learning techniques

Bias and Class Imbalance in Oncologic Data—Towards Inclusive and Transferrable AI in Large Scale Oncology Data Sets

Class imbalance on medical image classification: towards better evaluation practices for discrimination and calibration performance

Addressing Class Imbalance in Healthcare Data: Machine Learning Solutions for Age-Related Macular Degeneration and Preeclampsia

Handling imbalanced medical image data: A deep-learning-based one-class classification approach

Imbalanced class distribution and performance evaluation metrics: A systematic review of prediction accuracy for determining model performance in healthcare systems

Learning from Imbalanced Data: Integration of Advanced Resampling Techniques and Machine Learning Models for Enhanced Cancer Diagnosis and Prognosis

A Comparison of Resampling Techniques for Medical Data Using Machine Learning

Interaction effect between data discretization and data resampling for class-imbalanced medical datasets

A Novel Ensemble Learning Paradigm For Medical Diagnosis With Imbalanced Data

Benchmarking AutoML Frameworks for Disease Prediction Using Medical Claims