Abstract:Background Data discretization is an important preprocessing step in data mining for the transfer of continuous feature values to discrete ones, which allows some specific data mining algorithms to construct more effective models and facilitates the data mining process. Because many medical domain datasets are class imbalanced, data resampling methods, including oversampling, undersampling, and hybrid sampling methods, have been widely applied to rebalance the training set, facilitating effective differentiation between majority and minority classes. Objective Herein, we examine the effect of incorporating both data discretization and data resampling as steps in the analytical process on the classifier performance for class-imbalanced medical datasets. The order in which these two steps are carried out is compared in the experiments. Methods Two experimental studies were conducted, one based on 11 two-class imbalanced medical datasets and the other using 3 multiclass imbalanced medical datasets. In addition, the two discretization algorithms employed are ChiMerge and minimum description length principle (MDLP). On the other hand, the data resampling algorithms chosen for performance comparison are Tomek links undersampling, synthetic minority oversampling technique (SMOTE) oversampling, and SMOTE–Tomek hybrid sampling algorithms. Moreover, the support vector machine (SVM), C4.5 decision tree, and random forest (RF) techniques were used to examine the classification performances of the different approaches. Results The results show that on average, the combination approaches can allow the classifiers to provide higher area under the ROC curve (AUC) rates than the best baseline approach at approximately 0.8%–3.5% and 0.9%–2.5% for twoclass and multiclass imbalanced medical datasets, respectively. Particularly, the optimal results for two-class imbalanced datasets are obtained by performing the MDLP method first for data discretization and SMOTE second for oversampling, providing the highest AUC rate and requiring the least computational cost. For multiclass imbalanced datasets, performing SMOTE or SMOTE–Tomek first for data resampling and ChiMerge second for data discretization offers the best performances. Conclusions Classifiers with oversampling can provide better performances than the baseline method without oversampling. In contrast, performing data discretization does not necessarily make the classifiers outperform the baselines. On average, the combination approaches have potential to allow the classifiers to provide higher AUC rates than the best baseline approach.

The effect of methods addressing the class imbalance problem on P300 detection

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Solving the Data Imbalance Problem of P300 Detection Via Random Under-Sampling Bagging SVMs.

Epileptic Signal Classification Based on Synthetic Minority Oversampling and Blending Algorithm.

A New Sampling Approach for Classification of Imbalanced Data Sets with High Density.

An empirical evaluation of sampling methods for the classification of imbalanced data

Under-sampling Method Research in Class-Imbalanced Data

A novel algorithm to enhance P300 in single trials: application to lie detection using F-score and SVM

Tackling Class Imbalance Problem In Software Defect Prediction Through Cluster-Based Over-Sampling With Filtering

Over-sampling algorithm for imbalanced data classification

How Far Have We Progressed in the Sampling Methods for Imbalanced Data Classification? an Empirical Study

An Over Sampling Method of Unbalanced Data Based on Ant Colony Clustering

Improving P300 Speller performance by means of optimization and machine learning

An Improved Algorithm for Imbalanced Data and Small Sample Size Classification

Interaction effect between data discretization and data resampling for class-imbalanced medical datasets

Parameter Optimization in Face-Based P300 Speller System

A Cluster-Based Hybrid Sampling Approach for Imbalanced Data Classification.

The impact of the distance metric and measure on SMOTE-based techniques in software defect prediction

Over-sampling Algorithm Based on Preliminary Classification in Imbalanced Data Sets Learning

Exploiting Generalized Matched Filter for Efficient and Effective P300 Detection in Speller Paradigm.

Semi-supervised joint spatio-temporal feature selection for P300-based BCI speller