Abstract:Supervised training of deep learning models requires large labeled datasets. There is a growing interest in obtaining such datasets for medical image analysis applications. However, the impact of label noise has not received sufficient attention. Recent studies have shown that label noise can significantly impact the performance of deep learning models in many machine learning and computer vision applications. This is especially concerning for medical applications, where datasets are typically small, labeling requires domain expertise and suffers from high inter- and intra-observer variability, and erroneous predictions may influence decisions that directly impact human health. In this paper, we first review the state-of-the-art in handling label noise in deep learning. Then, we review studies that have dealt with label noise in deep learning for medical image analysis. Our review shows that recent progress on handling label noise in deep learning has gone largely unnoticed by the medical image analysis community. To help achieve a better understanding of the extent of the problem and its potential remedies, we conducted experiments with three medical imaging datasets with different types of label noise, where we investigated several existing strategies and developed new methods to combat the negative effect of label noise. Based on the results of these experiments and our review of the literature, we have made recommendations on methods that can be used to alleviate the effects of different types of label noise on deep models trained for medical image analysis. We hope that this article helps the medical image analysis researchers and developers in choosing and devising new techniques that effectively handle label noise in deep learning.

Deep Learning from Small Amount of Medical Data with Noisy Labels: A Meta-Learning Approach

Deep learning with noisy labels: Exploring techniques and remedies in medical image analysis

Learning from Noisy Labels with Decoupled Meta Label Purifier

A Survey of Label-Noise Deep Learning for Medical Image Analysis

Image Classification with Deep Learning in the Presence of Noisy Labels: A Survey

Label-noise-tolerant medical image classification via self-attention and self-supervised learning

Learning Image Labels On-the-fly for Training Robust Classification Models

Rectified Meta-Learning from Noisy Labels for Robust Image-based Plant Disease Diagnosis

Active Label Refinement for Robust Training of Imbalanced Medical Image Classification Tasks in the Presence of High Label Noise

Bayesian statistics guided label refurbishment mechanism: Mitigating label noise in medical image classification

Robust Medical Image Classification from Noisy Labeled Data with Global and Local Representation Guided Co-training

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Meta-Self-Training Based on Teacher–Student Network for Industrial Label-Noise Fault Diagnosis

Improving Medical Images Classification with Label Noise Using Dual-Uncertainty Estimation

Pick-and-Learn: Automatic Quality Evaluation for Noisy-Labeled Image Segmentation

Suppressing label noise in medical image classification using mixup attention and self-supervised learning

Hierarchical Noise-Tolerant Meta-Learning With Noisy Labels

Learning Confident Classifiers in the Presence of Label Noise

A Hybrid Robust-Learning Architecture for Medical Image Segmentation with Noisy Labels.

Sample Efficient Learning of Image-Based Diagnostic Classifiers Using Probabilistic Labels