Abstract:While machine learning algorithms hold promise for personalised medicine, their clinical adoption remains limited, partly due to biases that can compromise the reliability of predictions. In this paper, we focus on sample selection bias (SSB), a specific type of bias where the study population is less representative of the target population, leading to biased and potentially harmful decisions. Despite being well-known in the literature, SSB remains scarcely studied in machine learning for healthcare. Moreover, the existing machine learning techniques try to correct the bias mostly by balancing distributions between the study and the target populations, which may result in a loss of predictive performance. To address these problems, our study illustrates the potential risks associated with SSB by examining SSB's impact on the performance of machine learning algorithms. Most importantly, we propose a new research direction for addressing SSB, based on the target population identification rather than the bias correction. Specifically, we propose two independent networks(T-Net) and a multitasking network (MT-Net) for addressing SSB, where one network/task identifies the target subpopulation which is representative of the study population and the second makes predictions for the identified subpopulation. Our empirical results with synthetic and semi-synthetic datasets highlight that SSB can lead to a large drop in the performance of an algorithm for the target population as compared with the study population, as well as a substantial difference in the performance for the target subpopulations that are representative of the selected and the non-selected patients from the study population. Furthermore, our proposed techniques demonstrate robustness across various settings, including different dataset sizes, event rates, and selection rates, outperforming the existing bias correction techniques.

Correcting Sample Selection Bias for Image Classification

Correcting Classifiers for Sample Selection Bias in Two-Phase Case-Control Studies

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

Crowdsourcing Detection of Sampling Biases in Image Datasets

A Robust Classifier Under Missing-Not-At-Random Sample Selection Bias

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Unbiased active learning for image retrieval

Learning with Imbalanced Noisy Data by Preventing Bias in Sample Selection

Contrastive Open-set Active Learning based Sample Selection for Image Classification

Correcting Underrepresentation and Intersectional Bias for Classification

Study on Multi-label Image Classification Based on Sample Distribution Loss

Co-Correcting: Noise-Tolerant Medical Image Classification via Mutual Label Correction

Bias-Correction Feature Learner for Semi-Supervised Instance Segmentation

Classification under Data Contamination with Application to Remote Sensing Image Mis-registration

Synergistic Network Learning and Label Correction for Noise-robust Image Classification

A theory of learning from different domains

Learning with Biased Complementary Labels

Learning Image Labels On-the-fly for Training Robust Classification Models

Sample Selection Bias in Machine Learning for Healthcare

Twice Class Bias Correction for Imbalanced Semi-Supervised Learning