Abstract:Learning against label noise is a vital topic to guarantee a reliable performance for deep neural networks.Recent research usually refers to dynamic noise modeling with model output probabilities and loss values, and then separates clean and noisy samples.These methods have gained notable success. However, unlike cherry-picked data, existing approaches often cannot perform well when facing imbalanced datasets, a common scenario in the real world.We thoroughly investigate this phenomenon and point out two major issues that hinder the performance, i.e., inter-class loss distribution discrepancy and misleading predictions due to uncertainty.The first issue is that existing methods often perform class-agnostic noise modeling. However, loss distributions show a significant discrepancy among classes under class imbalance, and class-agnostic noise modeling can easily get confused with noisy samples and samples in minority classes.The second issue refers to that models may output misleading predictions due to epistemic uncertainty and aleatoric uncertainty, thus existing methods that rely solely on the output probabilities may fail to distinguish confident samples. Inspired by our observations, we propose an Uncertainty-aware Label Correction framework(ULC) to handle label noise on imbalanced datasets. First, we perform epistemic uncertainty-aware class-specific noise modeling to identify trustworthy clean samples and refine/discard highly confident true/corrupted labels.Then, we introduce aleatoric uncertainty in the subsequent learning process to prevent noise accumulation in the label noise modeling process. We conduct experiments on several synthetic and real-world datasets. The results demonstrate the effectiveness of the proposed method, especially on imbalanced datasets.

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

A Robust Classifier for Noise-corruption Learning

An joint end-to-end framework for learning with noisy labels

Making Deep Neural Networks Robust to Label Noise: A Reweighting Loss and Data Filtration

A Convergence Path to Deep Learning on Noisy Labels

Making Deep Neural Networks Robust to Label Noise: Cross-Training with a Novel Loss Function

Synergistic Network Learning and Label Correction for Noise-robust Image Classification

IDEAL: High-Order-Ensemble Adaptation Network for Learning with Noisy Labels

Meta-probability Weighting for Improving Reliability of DNNs to Label Noise

Denoising Noisy Neural Networks: A Bayesian Approach with Compensation.

When Sparse Neural Network Meets Label Noise Learning: A Multistage Learning Framework.

Confidence-based Reliable Learning under Dual Noises

Training Noise-Robust Deep Neural Networks Via Meta-Learning

Noisy-as-Clean: Learning Self-Supervised Denoising From Corrupted Image

On Better Detecting and Leveraging Noisy Samples for Learning with Severe Label Noise

Uncertainty-Aware Learning against Label Noise on Imbalanced Datasets

DECODE: Deep Confidence Network for Robust Image Classification

Learning Confident Classifiers in the Presence of Label Noise

DAT: Training Deep Networks Robust to Label-Noise by Matching the Feature Distributions

Learning Noisy Few-Shot Classification Without Relying on Pseudo-Noise Data