Abstract:With the help of machine learning (ML) techniques, the possible errors made by the pathologists and physicians, such as those caused by inexperience, fatigue, stress and so on can be avoided, and the medical data can be examined in a shorter time and in a more detailed manner. However, while the conventional ML techniques, such as classification, achieved excellent performance in classification accuracy when applied in medical diagnoses, they have a fatal shortcoming of poor performance since the imbalanced dataset, especially for the detection of the minority category. To tackle the shortcomings of conventional classification approaches, this study proposes a novel ensemble learning paradigm for medical diagnosis with imbalanced data, which consists of three phases: data pre-processing, training base classifier and final ensemble. In the first data pre-processing phase, we introduce the extension of Synthetic Minority Oversampling Technique (SMOTE) by integrating it with cross-validated committees filter (CVCF) technique, which can not only synthesize the minority sample and thereby balance the input instances, but also filter the noisy examples so as to perform well in the process of classification. In the classification phase, we introduce ensemble support vector machine (ESVM) classification technique, which were constructed by multiple diversity structures of SVM classifiers and thus has the advantages of strong generalization performance and classification precision. Additionally, in the last phase of the final ensemble strategy, we introduce the weighted majority voting strategy and introduce simulated annealing genetic algorithm (SAGA) to optimize the weight vector and thereby enhance the overall classification performance. The efficiency of our proposed ensemble learning method was tested on nine imbalanced medical datasets and the experimental results clearly indicate that the proposed ensemble learning paradigm outperforms other state-of-the-art classification models. Promisingly, our proposed ensemble learning paradigm can effectively facilitate medical decision making for physicians.

Utility Balanced Classification for Automatic Electronic Medical Record Analysis

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

Active Balancing Mechanism for Imbalanced Medical Data in Deep Learning–Based Classification Models

Class Weights Random Forest Algorithm for Processing Class Imbalanced Medical Data

IMLBoost for intelligent diagnosis with imbalanced medical records

Imbalanced Data Classification:A Survey and Experiments in Medical Domain

Addressing Binary Classification over Class Imbalanced Clinical Datasets Using Computationally Intelligent Techniques

Learning algorithm with non-balanced data for computer-aided diagnosis of breast cancer

IMBALANCED DATA CLASSIFICATION BASED ON EXTREME LEARNING MACHINE AUTOENCODER

Feature Fusion for Imbalanced ECG Data Analysis

Sample Imbalance Disease Classification Model Based on Association Rule Feature Selection

Bounded–abstaining Classification for Breast Tumors in Imbalanced Ultrasound Images

A Comparative Study on Application of Class-Imbalance Learning for Severity Prediction of Adverse Events Following Immunization

Overlap-Based Undersampling Method for Classification of Imbalanced Medical Datasets

A Novel Ensemble Learning Paradigm For Medical Diagnosis With Imbalanced Data

HypUC: Hyperfine Uncertainty Calibration with Gradient-boosted Corrections for Reliable Regression on Imbalanced Electrocardiograms

A Classification Method for Imbalance Data Set Based on Hybrid Strategy

A Novel Pre-processing Method for Classification Problems in Medical Intelligent Tasks

A learning method for the class imbalance problem with medical data sets

An Unsupervised Error Detection Methodology for Detecting Mislabels in Healthcare Analytics

Medical Knowledge-Guided Deep Learning for Imbalanced Medical Image Classification