Abstract:Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and discard high-loss ones to alleviate the negative impact of noisy labels. However, real-world datasets contain not only noisy labels but also class imbalance. The imbalance issue is prone to causing failure in the loss-based sample selection since the under-learning of tail classes also leans to produce high losses. To this end, we propose a simple yet effective method to address noisy labels in imbalanced datasets. Specifically, we propose Class-Balance-based sample Selection (CBS) to prevent the tail class samples from being neglected during training. We propose Confidence-based Sample Augmentation (CSA) for the chosen clean samples to enhance their reliability in the training process. To exploit selected noisy samples, we resort to prediction history to rectify labels of noisy samples. Moreover, we introduce the Average Confidence Margin (ACM) metric to measure the quality of corrected labels by leveraging the model's evolving training dynamics, thereby ensuring that low-quality corrected noisy samples are appropriately masked out. Lastly, consistency regularization is imposed on filtered label-corrected noisy samples to boost model performance. Comprehensive experimental results on synthetic and real-world datasets demonstrate the effectiveness and superiority of our proposed method, especially in imbalanced scenarios. Comprehensive experimental results on synthetic and real-world datasets demonstrate the effectiveness and superiority of our proposed method, especially in imbalanced scenarios.

A boosting method to detect noisy data

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

Boost AI Power: Data Augmentation Strategies with Unlabeled Data and Conformal Prediction, a Case in Alternative Herbal Medicine Discrimination with Electronic Nose

A Unified Framework for Connecting Noise Modeling to Boost Noise Detection

Novel hybrid ensemble credit scoring model with stacking-based noise detection and weight assignment

Learning with Imbalanced Noisy Data by Preventing Bias in Sample Selection

Improved Boosting Algorithm With Adaptive Filtration

The fuzzy support vector data description based on tightness for noisy label detection

MTForest: Ensemble Decision Trees based on Multi-Task Learning

A Study on the Noise Label Influence in Boosting Algorithms: AdaBoost, GBM and XGBoost

Reliable Label Correction is a Good Booster When Learning with Extremely Noisy Labels.

Mining Noisy Data Streams Via A Discriminative Model

DAT: Training Deep Networks Robust to Label-Noise by Matching the Feature Distributions

Leveraging an Alignment Set in Tackling Instance-Dependent Label Noise

Boosting Semi-Supervised Face Recognition With Noise Robustness

Learning to Abstain From Uninformative Data

An Imbalanced Data Classification Method Based on Automatic Clustering Under-Sampling

Noise-robust Oversampling for Imbalanced Data Classification