Abstract:Learning with noisy labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have a "small loss." However, this assumption often fails to generalize to some real-world cases with imbalanced subpopulations, that is, training subpopulations that vary in sample size or recognition difficulty. Therefore, recent LNL methods face the risk of misclassifying those "informative" samples (e.g., hard samples or samples in the tail subpopulations) into noisy samples, leading to poor generalization performance. To address this issue, we propose a novel LNL method to deal with noisy labels and imbalanced subpopulations simultaneously. It first leverages sample correlation to estimate samples' clean probabilities for label correction and then utilizes corrected labels for distributionally robust optimization (DRO) to further improve the robustness. Specifically, in contrast to previous works using classification loss as the selection criterion, we introduce a feature-based metric that takes the sample correlation into account for estimating samples' clean probabilities. Then, we refurbish the noisy labels using the estimated clean probabilities and the pseudo-labels from the model's predictions. With refurbished labels, we use DRO to train the model to be robust to subpopulation imbalance. Extensive experiments on a wide range of benchmarks demonstrate that our technique can consistently improve state-of-the-art (SOTA) robust learning paradigms against noisy labels, especially when encountering imbalanced subpopulations. We provide our code in https://github.com/chenmc1996/LNL-IS.

Countering Noisy Labels by Learning from Auxiliary Clean Labels

Rethinking Noisy Label Learning in Real-world Annotation Scenarios from the Noise-type Perspective

Learning from Noisy Labels with Decoupled Meta Label Purifier

Noisy Label Learning Based on Weighted Neighborhood Consistency

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Learning With Noisy Labels Over Imbalanced Subpopulations

Learning with Neighbor Consistency for Noisy Labels

Fine-Grained Classification with Noisy Labels

Neighborhood Collective Estimation for Noisy Label Identification and Correction

Two Wrongs Don't Make a Right: Combating Confirmation Bias in Learning with Label Noise.

Adaptive Integration of Partial Label Learning and Negative Learning for Enhanced Noisy Label Learning

On Better Detecting and Leveraging Noisy Samples for Learning with Severe Label Noise

Learning from Noisy Labels Via Meta Credible Label Elicitation.

Improving deep label noise learning with dual active label correction

An Efficient Noisy Label Learning Method with Semi-supervised Learning: An Efficient Noisy Label Learning Method with Semi-supervised Learning

Leveraging Noisy Labels of Nearest Neighbors for Label Correction and Sample Selection

Subclass-Dominant Label Noise: A Counterexample for the Success of Early Stopping

Learning from Noisy Labels with Coarse-to-Fine Sample Credibility Modeling

Co-LDL: A Co-Training-Based Label Distribution Learning Method for Tackling Label Noise

Reliable Label Correction is a Good Booster When Learning with Extremely Noisy Labels.

Combating Noisy Labels by Agreement: A Joint Training Method with Co-Regularization