Abstract:Learning with Noisy Labels (LNL) methods aim to improve the accuracy of Deep Neural Networks (DNNs) when the training set contains samples with noisy or incorrect labels, and have become popular in recent years. Existing popular LNL methods frequently regard samples with high learning difficulty (high-loss and low prediction probability) as noisy samples; however, irregular feature patterns from hard clean samples can also cause high learning difficulty, which can lead to the misclassification of hard clean samples as noisy samples. To address this insufficiency, we propose the Samples’ Learning Risk-based Learning with Noisy Labels (SLRLNL) method. Specifically, we propose to separate noisy samples from hard clean samples using samples’ learning risk, which represents samples’ influence on DNN’s accuracy . We show that samples’ learning risk is comprehensively determined by samples’ learning difficulty as well as samples’ feature similarity to other samples, and thus, compared to existing LNL methods that solely rely on the learning difficulty, our method can better separate hard clean samples from noisy samples, since the former frequently possess irregular feature patterns. Moreover, to extract more useful information from samples with irregular feature patterns (i.e., hard samples), we further propose the Relabeling-based Label Augmentation (RLA) process to prevent the memorization of hard noisy samples and better learn the hard clean samples, thus enhancing the learning for hard samples. Empirical studies show that samples’ learning risk can identify noisy samples more accurately, and the RLA process can enhance the learning for hard samples. To evaluate the effectiveness of our method, we compare it with popular existing LNL methods on CIFAR-10, CIFAR-100, Animal-10N, Clothing1M, and Docred. The experimental results indicate that our method outperforms other existing methods. The source code for SLRLNL can be found at https://github.com/yangbo1973/SLRLNL .

Small-Vote Sample Selection for Label-Noise Learning

VRLVMix: Combating Noisy Labels with Sample Selection Based on Loss Variation

Sample Selection with Uncertainty of Losses for Learning with Noisy Labels

Combating Label Noise With A General Surrogate Model For Sample Selection

Self-Filtering: A Noise-Aware Sample Selection for Label Noise with Confidence Penalization

Label-noise learning via uncertainty-aware neighborhood sample selection

Mitigating Memorization in Sample Selection for Learning with Noisy Labels

Regularly Truncated M-estimators for Learning with Noisy Labels

Learning with Imbalanced Noisy Data by Preventing Bias in Sample Selection

On Better Detecting and Leveraging Noisy Samples for Learning with Severe Label Noise

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Robust Noisy Label Learning via Two-Stream Sample Distillation

Centrality and Consistency: Two-Stage Clean Samples Identification for Learning with Instance-Dependent Noisy Labels

IdentifyMix: an Efficient Two-Stage Learning Approach to Combating Label Noise

Learning from Long-Tailed Noisy Data with Sample Selection and Balanced Loss.

A Static Bi-dimensional Sample Selection for Federated Learning with Label Noise.

Noisy Label Learning Based on Weighted Neighborhood Consistency

Learning with Noisy Labels Using Hyperspherical Margin Weighting

Separating Hard Clean Samples from Noisy Samples with Samples’ Learning Risk for DNN when Learning with Noisy Labels

Label-Noise Learning with Intrinsically Long-Tailed Data