Abstract:Leveraging inexpensive and human intervention-based annotating methodologies, such as crowdsourcing and web crawling, often leads to datasets with noisy labels. Noisy labels can have a detrimental impact on the performance and generalization of deep neural networks. Robust models that are able to handle and mitigate the effect of these noisy labels are thus essential. In this work, we explore the open challenges of neural network memorization and uncertainty in creating robust learning algorithms with noisy labels. To overcome them, we propose a novel framework called "Bayesian DivideMix++" with two critical components: (i) DivideMix++, to enhance the robustness against memorization and (ii) Monte-Carlo MixMatch, which focuses on improving the effectiveness towards label uncertainty. DivideMix++ improves the pipeline by integrating the warm-up and augmentation pipeline with self-supervised pre-training and dedicated different data augmentations for loss analysis and backpropagation. Monte-Carlo MixMatch leverages uncertainty measurements to mitigate the influence of uncertain samples by reducing their weight in the data augmentation MixMatch step. We validate our proposed pipeline using four datasets encompassing various synthetic and real-world noise settings. We demonstrate the effectiveness and merits of our proposed pipeline using extensive experiments. Bayesian DivideMix++ outperforms the state-of-the-art models by considerable differences in all experiments. Our findings underscore the potential of leveraging these modifications to enhance the performance and generalization of deep neural networks in practical scenarios.

Multi-Objective Interpolation Training for Robustness to Label Noise

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

Co-teaching + : Towards Training of Robust Deep Networks with Noisy Labels

Making Deep Neural Networks Robust to Label Noise: Cross-Training with a Novel Loss Function

Agreement or Disagreement in Noise-tolerant Mutual Learning?

Bayesian DivideMix++ for enhanced learning with noisy labels

Training Noise-Robust Deep Neural Networks Via Meta-Learning

Hybrid Noise-Oriented Multilabel Learning.

Contrastive Learning Improves Model Robustness Under Label Noise

Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels

Meta Joint Optimization: a Holistic Framework for Noisy-Labeled Visual Recognition

Alleviating Noisy-label Effects in Image Classification Via Probability Transition Matrix.

Boosting Co-teaching with Compression Regularization for Label Noise

Learning from Noisy Labels with Complementary Loss Functions

Suppressing label noise in medical image classification using mixup attention and self-supervised learning

One-step Noisy Label Mitigation

Adaptive Contrastive Learning for Learning Robust Representations under Label Noise.

Multi-task Label Noise Learning for Classification

DAT: Training Deep Networks Robust to Label-Noise by Matching the Feature Distributions

Combating Noisy Labels by Agreement: A Joint Training Method with Co-Regularization

Progressively Robust Loss for Deep Learning with Noisy Labels