Abstract:Learning with Noisy Labels (LNL) methods aim to improve the accuracy of Deep Neural Networks (DNNs) when the training set contains samples with noisy or incorrect labels, and have become popular in recent years. Existing popular LNL methods frequently regard samples with high learning difficulty (high-loss and low prediction probability) as noisy samples; however, irregular feature patterns from hard clean samples can also cause high learning difficulty, which can lead to the misclassification of hard clean samples as noisy samples. To address this insufficiency, we propose the Samples’ Learning Risk-based Learning with Noisy Labels (SLRLNL) method. Specifically, we propose to separate noisy samples from hard clean samples using samples’ learning risk, which represents samples’ influence on DNN’s accuracy . We show that samples’ learning risk is comprehensively determined by samples’ learning difficulty as well as samples’ feature similarity to other samples, and thus, compared to existing LNL methods that solely rely on the learning difficulty, our method can better separate hard clean samples from noisy samples, since the former frequently possess irregular feature patterns. Moreover, to extract more useful information from samples with irregular feature patterns (i.e., hard samples), we further propose the Relabeling-based Label Augmentation (RLA) process to prevent the memorization of hard noisy samples and better learn the hard clean samples, thus enhancing the learning for hard samples. Empirical studies show that samples’ learning risk can identify noisy samples more accurately, and the RLA process can enhance the learning for hard samples. To evaluate the effectiveness of our method, we compare it with popular existing LNL methods on CIFAR-10, CIFAR-100, Animal-10N, Clothing1M, and Docred. The experimental results indicate that our method outperforms other existing methods. The source code for SLRLNL can be found at https://github.com/yangbo1973/SLRLNL .

Leveraging Noisy Labels of Nearest Neighbors for Label Correction and Sample Selection

Neighborhood Collective Estimation for Noisy Label Identification and Correction

FGCM: Noisy Label Learning via Fine-Grained Confidence Modeling

Learning With Noisy Labels Over Imbalanced Subpopulations

Fine-Grained Classification with Noisy Labels

Learning from Noisy Labels with Decoupled Meta Label Purifier

Invariant Feature Based Label Correction for DNN when Learning with Noisy Labels

A Joint Training Framework for Learning with Noisy Labels

Linear Feature Source Prediction and Recombination Network for Noisy Label Learning

Separating Hard Clean Samples from Noisy Samples with Samples’ Learning Risk for DNN when Learning with Noisy Labels

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Robust Fine-Grained Visual Recognition With Neighbor-Attention Label Correction

Noisy Label Learning Based on Weighted Neighborhood Consistency

Countering Noisy Labels by Learning from Auxiliary Clean Labels

On Better Detecting and Leveraging Noisy Samples for Learning with Severe Label Noise

Towards harnessing feature embedding for robust learning with noisy labels

Label-noise learning via uncertainty-aware neighborhood sample selection

Scalable Penalized Regression for Noise Detection in Learning with Noisy Labels

Learning with noisy labels using collaborative sample selection and contrastive semi-supervised learning

Relative Prediction Probability based Label Correction Method for DNN when Learning with Noisy Labels in Class Imbalanced Dataset

Improving deep label noise learning with dual active label correction