Abstract:Noise transition matrix estimation is a promising approach for learning with label noise. It can infer clean posterior probabilities, known as Label Distribution (LD), based on noisy ones and reduce the impact of noisy labels. However, this estimation is challenging, since the ground truth labels are not always available. Most existing methods estimate a global noise transition matrix using either correctly labeled samples (anchor points) or detected reliable samples (pseudo anchor points). These methods heavily rely on the existence of anchor points or the quality of pseudo ones, and the global noise transition matrix can hardly provide accurate label transition information for each sample, since the label noise in real applications is mostly instance-dependent. To address these challenges, we propose an Instance-dependent Label Distribution Estimation (ILDE) method to learn from noisy labels for image classification. The method's workflow has three major steps. First, we estimate each sample's noisy posterior probability, supervised by noisy labels. Second, since mislabeling probability closely correlates with inter-class correlation, we compute the inter-class correlation matrix to estimate the noise transition matrix, bypassing the need for (pseudo) anchor points. Moreover, for a precise approximation of the instance-dependent noise transition matrix, we calculate the inter-class correlation matrix using only mini-batch samples rather than the entire training dataset. Third, we transform the noisy posterior probability into instance-dependent LD by multiplying it with the estimated noise transition matrix, using the resulting LD for enhanced supervision to prevent DCNNs from memorizing noisy labels. The proposed ILDE method has been evaluated against several state-of-the-art methods on two synthetic and three real-world noisy datasets. Our results indicate that the proposed ILDE method outperforms all competing methods, no matter whether the noise is synthetic or real noise.

Federated Learning with Instance-Dependent Noisy Label

Learning Cautiously in Federated Learning with Noisy and Heterogeneous Clients

FGCM: Noisy Label Learning via Fine-Grained Confidence Modeling

Federated Data Quality Assessment Approach: Robust Learning With Mixed Label Noise

FedNoRo: Towards Noise-Robust Federated Learning by Addressing Class Imbalance and Label Noise Heterogeneity

FedDiv: Collaborative Noise Filtering for Federated Learning with Noisy Labels

Curriculum-Based Federated Learning for Machine Fault Diagnosis with Noisy Labels

A Static Bi-dimensional Sample Selection for Federated Learning with Label Noise.

Federated Learning with Extremely Noisy Clients via Negative Distillation

Federated Label-Noise Learning with Local Diversity Product Regularization

Collaboratively Learning Federated Models from Noisy Decentralized Data

An Edge-Assisted Federated Contrastive Learning Method with Local Intrinsic Dimensionality in Noisy Label Environment

Overhead-free Noise-tolerant Federated Learning: A New Baseline

FedNoisy: Federated Noisy Label Learning Benchmark

Federated Learning with Heterogeneous Label Noise: A Dual Structure Approach

FedINC: an Exemplar-Free Continual Federated Learning Framework with Small Labeled Data

FedRGL: Robust Federated Graph Learning for Label Noise

Instance-dependent Label Distribution Estimation for Learning with Label Noise

Robust Federated Learning with Noisy Labeled Data Through Loss Function Correction

Overcoming Client Data Deficiency in Federated Learning by Exploiting Unlabeled Data on the Server

Tackling Noisy Clients in Federated Learning with End-to-end Label Correction