Abstract:Learning with noisy labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have a "small loss." However, this assumption often fails to generalize to some real-world cases with imbalanced subpopulations, that is, training subpopulations that vary in sample size or recognition difficulty. Therefore, recent LNL methods face the risk of misclassifying those "informative" samples (e.g., hard samples or samples in the tail subpopulations) into noisy samples, leading to poor generalization performance. To address this issue, we propose a novel LNL method to deal with noisy labels and imbalanced subpopulations simultaneously. It first leverages sample correlation to estimate samples' clean probabilities for label correction and then utilizes corrected labels for distributionally robust optimization (DRO) to further improve the robustness. Specifically, in contrast to previous works using classification loss as the selection criterion, we introduce a feature-based metric that takes the sample correlation into account for estimating samples' clean probabilities. Then, we refurbish the noisy labels using the estimated clean probabilities and the pseudo-labels from the model's predictions. With refurbished labels, we use DRO to train the model to be robust to subpopulation imbalance. Extensive experiments on a wide range of benchmarks demonstrate that our technique can consistently improve state-of-the-art (SOTA) robust learning paradigms against noisy labels, especially when encountering imbalanced subpopulations. We provide our code in https://github.com/chenmc1996/LNL-IS.

Learning from Open-Set Noisy Labels Based on Multi-Prototype Modeling

FGCM: Noisy Label Learning via Fine-Grained Confidence Modeling

Rethinking Noisy Label Learning in Real-world Annotation Scenarios from the Noise-type Perspective

Learning With Noisy Labels Over Imbalanced Subpopulations

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Iterative Learning with Open-set Noisy Labels

Learning with Neighbor Consistency for Noisy Labels

Learning from Noisy Labels with Noise Modeling Network

Neighborhood Collective Estimation for Noisy Label Identification and Correction

PNP: Robust Learning from Noisy Labels by Probabilistic Noise Prediction

Learning Multiple Gaussian Prototypes for Open-Set Recognition

Learning with Noisy Labels: Interconnection of Two Expectation-Maximizations

OHD: An Online Category-aware Framework for Learning with Noisy Labels under Long-Tailed Distribution

Learning with Noisy Class Labels for Instance Segmentation

Noise-Tolerant Hybrid Prototypical Learning with Noisy Web Data

Co-Learning Meets Stitch-Up for Noisy Multi-label Visual Recognition

Robust Image Classification with Noisy Labels by Negative Learning and Feature Space Renormalization

Unlocking the Power of Open Set : A New Perspective for Open-Set Noisy Label Learning

Hybrid Noise-Oriented Multilabel Learning.

LABELNET: Recovering Noisy Labels

LNL+K: Enhancing Learning with Noisy Labels Through Noise Source Knowledge Integration