Abstract:While collecting training data, even with the manual verification of experts from crowdsourcing platforms, eliminating incorrect annotations (noisy labels) completely is difficult and expensive. In dealing with datasets that contain noisy labels, over-parameterized deep neural networks (DNNs) tend to overfit, leading to poor generalization and classification performance. As a result, noisy label learning (NLL) has received significant attention in recent years. Existing research shows that although DNNs eventually fit all training data, they first prioritize fitting clean samples, then gradually overfit to noisy samples. Mainstream methods utilize this characteristic to divide training data but face two issues: class imbalance in the segmented data subsets and the optimization conflict between unsupervised contrastive representation learning and supervised learning. To address these issues, we propose a Balanced Partitioning and Training framework with Pseudo-Label Relaxed contrastive loss called BPT-PLR, which includes two crucial processes: a balanced partitioning process with a two-dimensional Gaussian mixture model (BP-GMM) and a semi-supervised oversampling training process with a pseudo-label relaxed contrastive loss (SSO-PLR). The former utilizes both semantic feature information and model prediction results to identify noisy labels, introducing a balancing strategy to maintain class balance in the divided subsets as much as possible. The latter adopts the latest pseudo-label relaxed contrastive loss to replace unsupervised contrastive loss, reducing optimization conflicts between semi-supervised and unsupervised contrastive losses to improve performance. We validate the effectiveness of BPT-PLR on four benchmark datasets in the NLL field: CIFAR-10/100, Animal-10N, and Clothing1M. Extensive experiments comparing with state-of-the-art methods demonstrate that BPT-PLR can achieve optimal or near-optimal performance.

Linear Feature Source Prediction and Recombination Network for Noisy Label Learning

Rethinking Noisy Label Learning in Real-world Annotation Scenarios from the Noise-type Perspective

When Sparse Neural Network Meets Label Noise Learning: A Multistage Learning Framework.

PNP: Robust Learning from Noisy Labels by Probabilistic Noise Prediction

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Neighborhood Collective Estimation for Noisy Label Identification and Correction

LABELNET: Recovering Noisy Labels

Leveraging Noisy Labels of Nearest Neighbors for Label Correction and Sample Selection

Scalable Penalized Regression for Noise Detection in Learning with Noisy Labels

BPT-PLR: A Balanced Partitioning and Training Framework with Pseudo-Label Relaxed Contrastive Loss for Noisy Label Learning

Towards harnessing feature embedding for robust learning with noisy labels

Learning with Neighbor Consistency for Noisy Labels

Feature-Induced Label Distribution for Learning with Noisy Labels

Robust Image Classification with Noisy Labels by Negative Learning and Feature Space Renormalization

Learning With Noisy Labels Over Imbalanced Subpopulations

Label Correction Using Contrastive Prototypical Classifier for Noisy Label Learning.

Learning from Noisy Labels Via Meta Credible Label Elicitation.

Invariant Feature Based Label Correction for DNN when Learning with Noisy Labels

Relative Prediction Probability based Label Correction Method for DNN when Learning with Noisy Labels in Class Imbalanced Dataset

An joint end-to-end framework for learning with noisy labels

On Better Detecting and Leveraging Noisy Samples for Learning with Severe Label Noise