Abstract:Focus on predictive algorithm and its performance evaluation is extensively covered in most research studies to determine best or appropriate predictive model with Optimum prediction solution indicated by prediction accuracy score, precision, recall, f1score etc. Prediction accuracy score from performance evaluation has been used extensively as the main determining metric for performance recommendation. It is one of the most widely used metric for identifying optimal prediction solution irrespective of dataset class distribution context or nature of dataset and output class distribution between the minority and majority variables. The key research question however is the impact of class inequality on prediction accuracy score in such datasets with output class distribution imbalance as compared to balanced accuracy score in the determination of model performance in healthcare and other real-world application systems. Answering this question requires an appraisal of current state of knowledge in both prediction accuracy score and balanced accuracy score use in real-world applications where there is unequal class distribution. Review of related works that highlight the use of imbalanced class distribution datasets with evaluation metrics will assist in contextualizing this systematic review. The incidence of unequal class distribution in real-world applications such as healthcare and other non-medical settings continue to receive attention due to machine learning technique challenges with minority class contribution in datasets with imbalanced class distribution. Challenges such as discounting minority class contribution which may be the subject of interest. Predictive modeling evaluation of such datasets with prediction accuracy score which does not take into account dataset class distribution variation could create an erroneous impression of a supposedly high performing machine learning technique as it discounts minority class contribution. Estimating predictive model performance with balanced accuracy score that incorporates other important metrics such as true positives, true positive rates, true negatives, true negative rates, false positive, false positive rates, false negatives and false negative rates could help assess machine learning model performance more adequately and accurately to determine appropriate model performance.

The harm of class imbalance corrections for risk prediction models: illustration and simulation using logistic regression

The harms of class imbalance corrections for machine learning based prediction models: a simulation study

Risk prediction models for discrete ordinal outcomes: calibration and the impact of the proportional odds assumption

Implications of resampling data to address the class imbalance problem (IRCIP): an evaluation of impact on performance between classification algorithms in medical data

Correcting Classifiers for Sample Selection Bias in Two-Phase Case-Control Studies

Sample size considerations and predictive performance of multinomial logistic prediction models

On the variability of regression shrinkage methods for clinical prediction models: simulation study on predictive performance

OUCH:Oversampling and Undersampling Cannot Help Improve Accuracy in our Bayesian Classifiers that Predict Preeclampsia

Enhancing Clinical Predictive Modeling through Model Complexity-Driven Class Proportion Tuning for Class Imbalanced Data: An Empirical Study on Opioid Overdose Prediction

Addressing Binary Classification over Class Imbalanced Clinical Datasets Using Computationally Intelligent Techniques

Imbalanced class distribution and performance evaluation metrics: A systematic review of prediction accuracy for determining model performance in healthcare systems

Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance

Logistic Regression with Misclassification in Binary Outcome Variables: a Method and Software

Counterfactual Prediction Under Outcome Measurement Error

A constrained maximum likelihood approach to developing well-calibrated models for predicting binary outcomes

Subpopulation-specific machine learning prognosis for underrepresented patients with double prioritized bias correction

The Effect of Balancing Methods on Model Behavior in Imbalanced Classification Problems

Predictive and explanatory models might miss informative features in educational data

Assessing the Impact of Case Correction Methods on the Fairness of COVID-19 Predictive Models

Balancing versus modelling in weighted analysis of non‐randomised studies with survival outcomes: A simulation study

A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes