Abstract:Deep neural networks have shown great success in representation learning. However, when learning with noisy labels (LNL), they can easily overfit and fail to generalize to new data. This paper introduces a simple and effective method, named Learning to Bootstrap (L2B), which enables models to bootstrap themselves using their own predictions without being adversely affected by erroneous pseudo-labels. It achieves this by dynamically adjusting the importance weight between real observed and generated labels, as well as between different samples through meta-learning. Unlike existing instance reweighting methods, the key to our method lies in a new, versatile objective that enables implicit relabeling concurrently, leading to significant improvements without incurring additional costs. L2B offers several benefits over the baseline methods. It yields more robust models that are less susceptible to the impact of noisy labels by guiding the bootstrapping procedure more effectively. It better exploits the valuable information contained in corrupted instances by adapting the weights of both instances and labels. Furthermore, L2B is compatible with existing LNL methods and delivers competitive results spanning natural and medical imaging tasks including classification and segmentation under both synthetic and real-world noise. Extensive experiments demonstrate that our method effectively mitigates the challenges of noisy labels, often necessitating few to no validation samples, and is well generalized to other tasks such as image segmentation. This not only positions it as a robust complement to existing LNL techniques but also underscores its practical applicability. The code and models are available at <a class="link-external link-https" href="https://github.com/yuyinzhou/l2b" rel="external noopener nofollow">this https URL</a>.

Learning With Noisy Labels Over Imbalanced Subpopulations

Fine-Grained Classification with Noisy Labels

LNL+K: Enhancing Learning with Noisy Labels Through Noise Source Knowledge Integration

OHD: An Online Category-aware Framework for Learning with Noisy Labels under Long-Tailed Distribution

L2B: Learning to Bootstrap Robust Models for Combating Label Noise

Learning with Noisy Labels Via Sparse Regularization

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Learning from Noisy Labels with Decoupled Meta Label Purifier

Leveraging Noisy Labels of Nearest Neighbors for Label Correction and Sample Selection

BadLabel: A Robust Perspective on Evaluating and Enhancing Label-noise Learning

Active Label Refinement for Robust Training of Imbalanced Medical Image Classification Tasks in the Presence of High Label Noise

Adaptive Integration of Partial Label Learning and Negative Learning for Enhanced Noisy Label Learning

Robust Long-Tailed Learning under Label Noise

Learning with noisy labels using collaborative sample selection and contrastive semi-supervised learning

Co-LDL: A Co-Training-Based Label Distribution Learning Method for Tackling Label Noise

Scalable Penalized Regression for Noise Detection in Learning with Noisy Labels

Learning with Noisy Class Labels for Instance Segmentation

Countering Noisy Labels by Learning from Auxiliary Clean Labels

RankMatch: Fostering Confidence and Consistency in Learning with Noisy Labels