Abstract:Label-noise learning (LNL) aims to increase the model's generalization given training data with noisy labels. To facilitate practical LNL algorithms, researchers have proposed different label noise types, ranging from class-conditional to instance-dependent noises. In this paper, we introduce a novel label noise type called BadLabel, which can significantly degrade the performance of existing LNL algorithms by a large margin. BadLabel is crafted based on the label-flipping attack against standard classification, where specific samples are selected and their labels are flipped to other labels so that the loss values of clean and noisy labels become indistinguishable. To address the challenge posed by BadLabel, we further propose a robust LNL method that perturbs the labels in an adversarial manner at each epoch to make the loss values of clean and noisy labels again distinguishable. Once we select a small set of (mostly) clean labeled data, we can apply the techniques of semi-supervised learning to train the model accurately. Empirically, our experimental results demonstrate that existing LNL algorithms are vulnerable to the newly introduced BadLabel noise type, while our proposed robust LNL method can effectively improve the generalization performance of the model under various types of label noise. The new dataset of noisy labels and the source codes of robust LNL algorithms are available at <a class="link-external link-https" href="https://github.com/zjfheart/BadLabels" rel="external noopener nofollow">this https URL</a>.

Robust Learning with Adversarial Perturbations and Label Noise

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Analyze the Robustness of Classifiers under Label Noise

Effective and Robust Adversarial Training against Data and Label Corruptions

Training Robust Deep Neural Networks via Adversarial Noise Propagation

Towards Robust Graph Neural Networks against Label Noise

Robustness and Reliability When Training With Noisy Labels

BadLabel: A Robust Perspective on Evaluating and Enhancing Label-noise Learning

Robust Unlearnable Examples: Protecting Data Against Adversarial Learning

PNP: Robust Learning from Noisy Labels by Probabilistic Noise Prediction

Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approach

Dynamic Label Adversarial Training for Deep Learning Robustness Against Adversarial Attacks

Robust Adversarial Perturbation on Deep Proposal-based Models

Nrat: towards adversarial training with inherent label noise

Robust Long-Tailed Learning under Label Noise

Learning Task-aware Robust Deep Learning Systems

Robust Unlearnable Examples: Protecting Data Privacy Against Adversarial Learning

Robust Loss Functions under Label Noise for Deep Neural Networks

DAT: Training Deep Networks Robust to Label-Noise by Matching the Feature Distributions