Abstract:Introduction: Computational methods are crucial for efficient and cost-effective drug toxicity prediction. Unfortunately, the data used for prediction is often imbalanced, resulting in biased models that favor the majority class. This paper proposes an approach to apply a hybrid class balancing technique and evaluate its performance on computational models for toxicity prediction in Tox21 datasets. Methods: The process begins by converting chemical compound data structures (SMILES strings) from various bioassay datasets into molecular descriptors that can be processed by algorithms. Subsequently, Undersampling and Oversampling techniques are applied in two different schemes on the training data. In the first scheme (Individual), only one balancing technique (Oversampling or Undersampling) is used. In the second scheme (Hybrid), the training data is divided according to a ratio (e.g., 90-10), applying a different balancing technique to each proportion. We considered eight resampling techniques (four Oversampling and four Undersampling), six molecular descriptors (based on MACCS, ECFP, and Mordred), and five classification models (KNN, MLP, RF, XGB and SVM) over 10 bioassay datasets to determine the configurations that yield the best performance. Results: We defined three testing scenarios: without balancing techniques (baseline), Individual, and Hybrid. We found that using the ENN technique in the MACCS-MLP combination resulted in a 10.01% improvement in performance. The increase for ECFP6-2048 was 16.47% after incorporating a combination of the SMOTE (10%) and RUS (90%) techniques. Meanwhile, using the same combination of techniques, MORDRED-XGB showed the most significant increase in performance, achieving a 22.62% improvement. Conclusion: Integrating any of the class balancing schemes resulted in a minimum of 10.01% improvement in prediction performance compared to the best baseline configuration. In this study, Undersampling techniques were more appropriate due to the significant overlap among samples. By eliminating specific samples from the predominant class that are close to the minority class, this overlap is greatly reduced.

Enhancing Clinical Predictive Modeling through Model Complexity-Driven Class Proportion Tuning for Class Imbalanced Data: An Empirical Study on Opioid Overdose Prediction

An Oversampling-enhanced Multi-class Imbalanced Classification Framework for Patient Health Status Prediction Using Patient-reported Outcomes

Predictive analytics with gradient boosting in clinical medicine

Imbalance-Aware Uplift Modeling for Observational Data

The harm of class imbalance corrections for risk prediction models: illustration and simulation using logistic regression

A competing risks regression model for the association between time-varying opioid exposure and risk of overdose

Processing imbalanced medical data at the data level with assisted-reproduction data as an example

Outcome Prediction in Clinical Treatment Processes

An interpretable machine learning framework for opioid overdose surveillance from emergency medical services records

Imbalanced Target Prediction with Pattern Discovery on Clinical Data Repositories

Addressing Binary Classification over Class Imbalanced Clinical Datasets Using Computationally Intelligent Techniques

Leveraging auxiliary measures: a deep multi-task neural network for predictive modeling in clinical research

Hybrid Class Balancing Approach for Chemical Compound Toxicity Prediction

Predicting Opioid Use Outcomes in Minoritized Communities

A Big Data Analytics Framework to Predict the Risk of Opioid Use Disorder

A Comorbidity Knowledge-Aware Model for Disease Prognostic Prediction

Density-Aware Personalized Training for Risk Prediction in Imbalanced Medical Data

Identification of influence factors in overweight population through an interpretable risk model based on machine learning: a large retrospective cohort

The harms of class imbalance corrections for machine learning based prediction models: a simulation study

Spatiotemporal Forecasting of Opioid-Related Fatal Overdoses: Towards Best Practices for Modeling and Evaluation