Abstract:Learning with noisy-labels has become an important research topic in computer vision where state-of-the-art (SOTA) methods explore: 1) prediction disagreement with co-teaching strategy that updates two models when they disagree on the prediction of training samples; and 2) sample selection to divide the training set into clean and noisy sets based on small training loss. However, the quick convergence of co-teaching models to select the same clean subsets combined with relatively fast overfitting of noisy labels may induce the wrong selection of noisy label samples as clean, leading to an inevitable confirmation bias that damages accuracy. In this paper, we introduce our noisy-label learning approach, called Asymmetric Co-teaching (AsyCo), which introduces novel prediction disagreement that produces more consistent divergent results of the co-teaching models, and a new sample selection approach that does not require small-loss assumption to enable a better robustness to confirmation bias than previous methods. More specifically, the new prediction disagreement is achieved with the use of different training strategies, where one model is trained with multi-class learning and the other with multi-label learning. Also, the new sample selection is based on multi-view consensus, which uses the label views from training labels and model predictions to divide the training set into clean and noisy for training the multi-class model and to re-label the training samples with multiple top-ranked labels for training the multi-label model. Extensive experiments on synthetic and real-world noisy-label datasets show that AsyCo improves over current SOTA methods.

Co-teaching + : Towards Training of Robust Deep Networks with Noisy Labels

Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels

How does Disagreement Help Generalization against Label Corruption?

Gradient Agreement Hinders the Memorization of Noisy Labels

Consensus Co-teaching for Dynamically Learning with Noisy Labels

Three-teaching: A Three-Way Decision Framework to Handle Noisy Labels

Combating Noisy Labels by Agreement: A Joint Training Method with Co-Regularization

Co-learning: Learning from Noisy Labels with Self-supervision

Combating noisy labels by agreement: A joint training method with co-regularization

Asymmetric Co-teaching with Multi-view Consensus for Noisy Label Learning

Co-sampling: Training Robust Networks for Extremely Noisy Supervision.

Agreement or Disagreement in Noise-tolerant Mutual Learning?

Cooperative Learning for Noisy Supervision.

Boosting Co-teaching with Compression Regularization for Label Noise

Enhancing Robustness in Learning with Noisy Labels: an Asymmetric Co-Training Approach

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Mutual calibration training: Training deep neural networks with noisy labels using dual-models

Making Deep Neural Networks Robust to Label Noise: Cross-Training with a Novel Loss Function

Coresets for Robust Training of Neural Networks against Noisy Labels

CJC-net: A cyclical training method with joint loss and co-teaching strategy net for deep learning under noisy labels

Cross-Training Deep Neural Networks for Learning from Label Noise