Abstract:Computer-aided vibrational spectroscopy detection technology has achieved promising results in the field of early disease diagnosis. Yet limited by factors such as the number of actual samples and the cost of spectral acquisition in clinical medicine, the data available for model training are insufficient, and the amount of data varies greatly between different diseases, which constrain the performance optimization and enhancement of the diagnostic model. In this study, vibrational spectroscopy data of three common diseases are selected as research objects, and experimental research is conducted around the class imbalance situation that exists in medical data. When dealing with the challenge of class imbalance in medical vibrational spectroscopy research, it no longer relies on some kind of independent and single method, but considers the combined effect of multiple strategies. SVM, K-Nearest Neighbor (KNN), and Decision Tree (DT) are used as baseline comparison models on Raman spectroscopy medical datasets with different imbalance rates. The performance of the three strategies, Ensemble Learning, Feature Extraction, and Resampling, is verified on the class imbalance dataset by G-mean and AUC metrics, respectively. The results show that all the above three methods mitigate the negative impact caused by unbalanced learning. Based on this, we propose a hybrid ensemble classifier (HEC) that integrates resampling, feature extraction, and ensemble learning to verify the effectiveness of the hybrid learning strategy in solving the class imbalance problem. The G-mean and AUC values of the HEC method are 82.7 % and 83.12 % for the HBV dataset, is 2.02 % and 1.98 % higher than the optimal strategy; 83.62 % and 83.76 % for the HCV dataset, is 9.79 % and 8.47 % higher than the optimal strategy; while for the thyroid dysfunction dataset are 77.56 % and 77.85 %, is 6.92 % and 6.36 % higher than that of the optimal strategy, respectively. The experimental results show that the G-mean and AUC metrics of the HEC method are higher than those of the baseline classifier as well as the optimal combination using separate strategies. It can be seen that the HEC method can effectively counteract the unfavorable effects of imbalance learning and is expected to be applied to a wider range of imbalance scenarios.

Sample Imbalance Disease Classification Model Based on Association Rule Feature Selection

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

Research of Medical High-Dimensional Imbalanced Data Classification Ensemble Feature Selection Algorithm with Random Forest

Learning algorithm with non-balanced data for computer-aided diagnosis of breast cancer

A Study of Data Pre-processing Techniques for Imbalanced Biomedical Data Classification

Imbalanced Sample Selection with Deep Reinforcement Learning for Fault Diagnosis

Imbalanced Data Classification:A Survey and Experiments in Medical Domain

Sample and feature selecting based ensemble learning for imbalanced problems

An Empirical Study on the Joint Impact of Feature Selection and Data Re-sampling on Imbalance Classification

An adaptive loss backward feature elimination method for class-imbalanced and mixed-type data in medical diagnosis

The imbalance problem: A comparison of sampling approaches using different parameters and feature selection methods in the context of classification

Classification algorithm for class imbalanced data based on optimized Mahalanobis-Taguchi system

A learning method for the class imbalance problem with medical data sets

Addressing Binary Classification over Class Imbalanced Clinical Datasets Using Computationally Intelligent Techniques

Overlap-Based Undersampling Method for Classification of Imbalanced Medical Datasets

Imbalanced Data Classification Based on Improved Random-SMOTE and Feature Standard Deviation

A class-imbalanced hybrid learning strategy based on Raman spectroscopy of serum samples for the diagnosis of hepatitis B, hepatitis A, and thyroid dysfunction

Learning from Imbalanced Data: Integration of Advanced Resampling Techniques and Machine Learning Models for Enhanced Cancer Diagnosis and Prognosis

Diabetes prediction model for unbalanced community follow-up data set based on optimal feature selection and scorecard

Boosting medical diagnostics with a novel gradient-based sample selection method