Abstract:Weakly supervised segmentation (WSS) aims to exploit weak forms of annotations to achieve the segmentation training, thereby reducing the burden on annotation. However, existing methods rely on large-scale centralized datasets, which are difficult to construct due to privacy concerns on medical data. Federated learning (FL) provides a cross-site training paradigm and shows great potential to address this problem. In this work, we represent the first effort to formulate federated weakly supervised segmentation (FedWSS) and propose a novel Federated Drift Mitigation (FedDM) framework to learn segmentation models across multiple sites without sharing their raw data. FedDM is devoted to solving two main challenges (i.e., local drift on client-side optimization and global drift on server-side aggregation) caused by weak supervision signals in FL setting via Collaborative Annotation Calibration (CAC) and Hierarchical Gradient De-conflicting (HGD). To mitigate the local drift, CAC customizes a distal peer and a proximal peer for each client via a Monte Carlo sampling strategy, and then employs inter-client knowledge agreement and disagreement to recognize clean labels and correct noisy labels, respectively. Moreover, in order to alleviate the global drift, HGD online builds a client hierarchy under the guidance of history gradient of the global model in each communication round. Through de-conflicting clients under the same parent nodes from bottom layers to top layers, HGD achieves robust gradient aggregation at the server side. Furthermore, we theoretically analyze FedDM and conduct extensive experiments on public datasets. The experimental results demonstrate the superior performance of our method compared with state-of-the-art approaches. The source code is available at https://github.com/CityU-AIM-Group/FedDM.

FedCD: Federated Semi-Supervised Learning with Class Awareness Balance via Dual Teachers

FedCD: A Classifier Debiased Federated Learning Framework for Non-IID Data

Federated Semi-supervised Learning with Dual Regulator

Class Imbalanced Medical Image Classification Based on Semi-Supervised Federated Learning

Class-Imbalance and Client-Imbalance Federated Learning for Fault Diagnosis

Class Balanced Adaptive Pseudo Labeling for Federated Semi-Supervised Learning

Asymmetrical Reciprocity-based Federated Learning for Resolving Disparities in Medical Diagnosis

FedSLD: Federated Learning with Shared Label Distribution for Medical Image Classification

Federated Semi-Supervised Learning Through a Combination of Self and Cross Model Ensembling

Little is Enough: Boosting Privacy by Sharing Only Hard Labels in Federated Semi-Supervised Learning

Dynamic Bank Learning for Semi-supervised Federated Image Diagnosis with Class Imbalance

Addressing Class Variable Imbalance in Federated Semi-supervised Learning

FedDistill: Global Model Distillation for Local Model De-Biasing in Non-IID Federated Learning

Federated Distillation for Medical Image Classification: Towards Trustworthy Computer-Aided Diagnosis

Non-IID always Bad? Semi-Supervised Heterogeneous Federated Learning with Local Knowledge Enhancement

Semi-Supervised Federated Learning with Non-Iid Data: Algorithm and System Design

Medical Federated Model with Mixture of Personalized and Shared Components

Medical Federated Model with Mixture of Personalized and Sharing Components

FedDM: Federated Weakly Supervised Segmentation via Annotation Calibration and Gradient De-conflicting

MetaFed: Federated Learning Among Federations With Cyclic Knowledge Distillation for Personalized Healthcare

Federated Learning with Bilateral Curation for Partially Class-Disjoint Data