Abstract:Noise transition matrix estimation is a promising approach for learning with label noise. It can infer clean posterior probabilities, known as Label Distribution (LD), based on noisy ones and reduce the impact of noisy labels. However, this estimation is challenging, since the ground truth labels are not always available. Most existing methods estimate a global noise transition matrix using either correctly labeled samples (anchor points) or detected reliable samples (pseudo anchor points). These methods heavily rely on the existence of anchor points or the quality of pseudo ones, and the global noise transition matrix can hardly provide accurate label transition information for each sample, since the label noise in real applications is mostly instance-dependent. To address these challenges, we propose an Instance-dependent Label Distribution Estimation (ILDE) method to learn from noisy labels for image classification. The method's workflow has three major steps. First, we estimate each sample's noisy posterior probability, supervised by noisy labels. Second, since mislabeling probability closely correlates with inter-class correlation, we compute the inter-class correlation matrix to estimate the noise transition matrix, bypassing the need for (pseudo) anchor points. Moreover, for a precise approximation of the instance-dependent noise transition matrix, we calculate the inter-class correlation matrix using only mini-batch samples rather than the entire training dataset. Third, we transform the noisy posterior probability into instance-dependent LD by multiplying it with the estimated noise transition matrix, using the resulting LD for enhanced supervision to prevent DCNNs from memorizing noisy labels. The proposed ILDE method has been evaluated against several state-of-the-art methods on two synthetic and three real-world noisy datasets. Our results indicate that the proposed ILDE method outperforms all competing methods, no matter whether the noise is synthetic or real noise.

ENLD: Efficient Noisy Label Detection for Incremental Datasets in Data Lake.

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

Co-LDL: A Co-Training-Based Label Distribution Learning Method for Tackling Label Noise

Inconsistency Ranking-based Noisy Label Detection for High-quality Data

Scalable Penalized Regression for Noise Detection in Learning with Noisy Labels

Learning to Detect Noisy Labels Using Model-Based Features

Adaptive Integration of Partial Label Learning and Negative Learning for Enhanced Noisy Label Learning

Instance-dependent Label Distribution Estimation for Learning with Label Noise

Label Distribution Learning with Noisy Labels Via Three-Way Decisions

LNL+K: Enhancing Learning with Noisy Labels Through Noise Source Knowledge Integration

Addressing Long-Tail Noisy Label Learning Problems: a Two-Stage Solution with Label Refurbishment Considering Label Rarity

Multi-class Label Noise Learning via Loss Decomposition and Centroid Estimation

Remote Sensing Image Scene Classification with Noisy Label Distillation

An Edge-Assisted Federated Contrastive Learning Method with Local Intrinsic Dimensionality in Noisy Label Environment

OHD: An Online Category-aware Framework for Learning with Noisy Labels under Long-Tailed Distribution

Learning With Noisy Labels Over Imbalanced Subpopulations

A Survey of Label-noise Representation Learning: Past, Present and Future

NGC: A Unified Framework for Learning with Open-World Noisy Data

DIRECT: Deep Active Learning under Imbalance and Label Noise

DAT: Training Deep Networks Robust to Label-Noise by Matching the Feature Distributions

Improving deep label noise learning with dual active label correction