Abstract:Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and discard high-loss ones to alleviate the negative impact of noisy labels. However, real-world datasets contain not only noisy labels but also class imbalance. The imbalance issue is prone to causing failure in the loss-based sample selection since the under-learning of tail classes also leans to produce high losses. To this end, we propose a simple yet effective method to address noisy labels in imbalanced datasets. Specifically, we propose Class-Balance-based sample Selection (CBS) to prevent the tail class samples from being neglected during training. We propose Confidence-based Sample Augmentation (CSA) for the chosen clean samples to enhance their reliability in the training process. To exploit selected noisy samples, we resort to prediction history to rectify labels of noisy samples. Moreover, we introduce the Average Confidence Margin (ACM) metric to measure the quality of corrected labels by leveraging the model's evolving training dynamics, thereby ensuring that low-quality corrected noisy samples are appropriately masked out. Lastly, consistency regularization is imposed on filtered label-corrected noisy samples to boost model performance. Comprehensive experimental results on synthetic and real-world datasets demonstrate the effectiveness and superiority of our proposed method, especially in imbalanced scenarios. Comprehensive experimental results on synthetic and real-world datasets demonstrate the effectiveness and superiority of our proposed method, especially in imbalanced scenarios.

A New Method of Training Sample Selection in Text Classification

Feature selection method based on backward cloud model in text classification

Feature Selection Method on Imbalanced Text

A Technique For Improving The Performance Of Naive Bayes Text Classification

Rethinking Noisy Label Learning in Real-world Annotation Scenarios from the Noise-type Perspective

A Novel Feature Selection Approach and Feature Weight Adjustment Technique in Text Classification

Improving Short Text Classification Through Better Feature Space Selection

Automatic Noise Generation and Reduction for Text Classification

Learning with Imbalanced Noisy Data by Preventing Bias in Sample Selection

An Effective Feature Selection Method For Text Categorization

Combating Label Noise With A General Surrogate Model For Sample Selection

An Approach to Sample Selection from Big Data for Classification

A Method for Eliminating Class Noise in Text Classification Based on Feature Class Attribute

Efficient Method for Feature Selection in Text Classification

Mitigating Memorization in Sample Selection for Learning with Noisy Labels

A New Method of Sample Reduction for Support Vector Classification

A Feature Selection Method Based on Class Feature Domains for Text Categorization

A Probabilistic Topic Model Based Noise Processing Method for Text Classification

Learning from Long-Tailed Noisy Data with Sample Selection and Balanced Loss.

A discriminative model selection approach and its application to text classification