Abstract:Federated learning (FL) has shown remarkable success in cooperatively training deep models, while typically struggling with noisy labels. Advanced works propose to tackle label noise by a re-weighting strategy with a strong assumption, i.e., mild label noise. However, it may be violated in many real-world FL scenarios because of highly contaminated clients, resulting in extreme noise ratios, e.g., $>$90%. To tackle extremely noisy clients, we study the robustness of the re-weighting strategy, showing a pessimistic conclusion: minimizing the weight of clients trained over noisy data outperforms re-weighting strategies. To leverage models trained on noisy clients, we propose a novel approach, called negative distillation (FedNed). FedNed first identifies noisy clients and employs rather than discards the noisy clients in a knowledge distillation manner. In particular, clients identified as noisy ones are required to train models using noisy labels and pseudo-labels obtained by global models. The model trained on noisy labels serves as a `bad teacher' in knowledge distillation, aiming to decrease the risk of providing incorrect information. Meanwhile, the model trained on pseudo-labels is involved in model aggregation if not identified as a noisy client. Consequently, through pseudo-labeling, FedNed gradually increases the trustworthiness of models trained on noisy clients, while leveraging all clients for model aggregation through negative distillation. To verify the efficacy of FedNed, we conduct extensive experiments under various settings, demonstrating that FedNed can consistently outperform baselines and achieve state-of-the-art performance. Our code is available at <a class="link-external link-https" href="https://github.com/linChen99/FedNed" rel="external noopener nofollow">this https URL</a>.

Curriculum-Based Federated Learning for Machine Fault Diagnosis with Noisy Labels

Learning Cautiously in Federated Learning with Noisy and Heterogeneous Clients

FGCM: Noisy Label Learning via Fine-Grained Confidence Modeling

Class-Imbalance and Client-Imbalance Federated Learning for Fault Diagnosis

FedNoRo: Towards Noise-Robust Federated Learning by Addressing Class Imbalance and Label Noise Heterogeneity

Medical federated learning with joint graph purification for noisy label learning

Federated Data Quality Assessment Approach: Robust Learning With Mixed Label Noise

Federated Label-Noise Learning with Local Diversity Product Regularization

Federated Learning with Instance-Dependent Noisy Label

Tackling Noisy Clients in Federated Learning with End-to-end Label Correction

Privacy-Preserving Federated Learning Against Label-Flipping Attacks on Non-IID Data

FedFixer: Mitigating Heterogeneous Label Noise in Federated Learning

Federated Learning with Extremely Noisy Clients via Negative Distillation

LAFD-Net: Learning with Noisy Pseudo-Labels for Semisupervised Bearing Fault Diagnosis

Collaboratively Learning Federated Models from Noisy Decentralized Data

Dynamic Semi-Supervised Federated Learning Fault Diagnosis Method Based on an Attention Mechanism

Federated Learning with Heterogeneous Label Noise: A Dual Structure Approach

A personalized federated meta-learning method for intelligent and privacy-preserving fault diagnosis

Noise-aware Local Model Training Mechanism for Federated Learning

Overhead-free Noise-tolerant Federated Learning: A New Baseline

A Static Bi-dimensional Sample Selection for Federated Learning with Label Noise.