Abstract:Deep neural networks have shown great success in representation learning. However, when learning with noisy labels (LNL), they can easily overfit and fail to generalize to new data. This paper introduces a simple and effective method, named Learning to Bootstrap (L2B), which enables models to bootstrap themselves using their own predictions without being adversely affected by erroneous pseudo-labels. It achieves this by dynamically adjusting the importance weight between real observed and generated labels, as well as between different samples through meta-learning. Unlike existing instance reweighting methods, the key to our method lies in a new, versatile objective that enables implicit relabeling concurrently, leading to significant improvements without incurring additional costs. L2B offers several benefits over the baseline methods. It yields more robust models that are less susceptible to the impact of noisy labels by guiding the bootstrapping procedure more effectively. It better exploits the valuable information contained in corrupted instances by adapting the weights of both instances and labels. Furthermore, L2B is compatible with existing LNL methods and delivers competitive results spanning natural and medical imaging tasks including classification and segmentation under both synthetic and real-world noise. Extensive experiments demonstrate that our method effectively mitigates the challenges of noisy labels, often necessitating few to no validation samples, and is well generalized to other tasks such as image segmentation. This not only positions it as a robust complement to existing LNL techniques but also underscores its practical applicability. The code and models are available at <a class="link-external link-https" href="https://github.com/yuyinzhou/l2b" rel="external noopener nofollow">this https URL</a>.

Cross-Validation Is All You Need: A Statistical Approach To Label Noise Estimation

An Ensemble Noise-Robust K-fold Cross-Validation Selection Method for Noisy Labels

Iterative Cross Learning on Noisy Labels

Improving Medical Images Classification with Label Noise Using Dual-Uncertainty Estimation

Robustness and Reliability When Training With Noisy Labels

Co-Correcting: Noise-Tolerant Medical Image Classification via Mutual Label Correction

Making Deep Neural Networks Robust to Label Noise: Cross-Training with a Novel Loss Function

Analyze the Robustness of Classifiers under Label Noise

Making Deep Neural Networks Robust to Label Noise: A Reweighting Loss and Data Filtration

Deep learning with noisy labels in medical prediction problems: a scoping review

Deep learning with noisy labels: Exploring techniques and remedies in medical image analysis

Hybrid Label Noise Correction Algorithm for Medical Auxiliary Diagnosis

L2B: Learning to Bootstrap Robust Models for Combating Label Noise

Bayesian statistics guided label refurbishment mechanism: Mitigating label noise in medical image classification

A Model-Agnostic Approach for Learning with Noisy Labels of Arbitrary Distributions

Label-noise-tolerant medical image classification via self-attention and self-supervised learning

Curriculum Fine-tuning of Vision Foundation Model for Medical Image Classification Under Label Noise

Is K-fold cross validation the best model selection method for Machine Learning?

Noisy Label Learning for Large-scale Medical Image Classification

Limited Gradient Descent: Learning With Noisy Labels

A Convergence Path to Deep Learning on Noisy Labels