Abstract:Learning with noisy-labels has become an important research topic in computer vision where state-of-the-art (SOTA) methods explore: 1) prediction disagreement with co-teaching strategy that updates two models when they disagree on the prediction of training samples; and 2) sample selection to divide the training set into clean and noisy sets based on small training loss. However, the quick convergence of co-teaching models to select the same clean subsets combined with relatively fast overfitting of noisy labels may induce the wrong selection of noisy label samples as clean, leading to an inevitable confirmation bias that damages accuracy. In this paper, we introduce our noisy-label learning approach, called Asymmetric Co-teaching (AsyCo), which introduces novel prediction disagreement that produces more consistent divergent results of the co-teaching models, and a new sample selection approach that does not require small-loss assumption to enable a better robustness to confirmation bias than previous methods. More specifically, the new prediction disagreement is achieved with the use of different training strategies, where one model is trained with multi-class learning and the other with multi-label learning. Also, the new sample selection is based on multi-view consensus, which uses the label views from training labels and model predictions to divide the training set into clean and noisy for training the multi-class model and to re-label the training samples with multiple top-ranked labels for training the multi-label model. Extensive experiments on synthetic and real-world noisy-label datasets show that AsyCo improves over current SOTA methods.

Three-teaching: A Three-Way Decision Framework to Handle Noisy Labels

Co-teaching + : Towards Training of Robust Deep Networks with Noisy Labels

Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels

Gradient Agreement Hinders the Memorization of Noisy Labels

Consensus Co-teaching for Dynamically Learning with Noisy Labels

Asymmetric Co-teaching with Multi-view Consensus for Noisy Label Learning

A Co-Training Approach for Sequential Three-Way Decisions

Three-way Decision with Co-Training for Partially Labeled Data

How does Disagreement Help Generalization against Label Corruption?

When Sparse Neural Network Meets Label Noise Learning: A Multistage Learning Framework.

Cross-Training Deep Neural Networks for Learning from Label Noise

Three-way Decision-Based Noise Correction for Crowdsourcing

Combating Noisy Labels by Agreement: A Joint Training Method with Co-Regularization

Co-learning: Learning from Noisy Labels with Self-supervision

Data Fusing and Joint Training for Learning with Noisy Labels

Agreement or Disagreement in Noise-tolerant Mutual Learning?

Boosting Co-teaching with Compression Regularization for Label Noise

Combating noisy labels by agreement: A joint training method with co-regularization

Teaching-to-Learn and Learning-to-Teach for Few Labeled Classification.

Cross-to-merge training with class balance strategy for learning with noisy labels

Mutual calibration training: Training deep neural networks with noisy labels using dual-models