Abstract:Federated learning (FL) enables multiple sites to collaboratively train powerful deep models without compromising data privacy and security. The statistical heterogeneity (e.g., non-IID data and domain shifts) is a primary obstacle in FL, impairing the generalization performance of the global model. Weakly supervised segmentation, which uses sparsely-grained (i.e., point-, bounding box-, scribble-, block-wise) supervision, is increasingly being paid attention to due to its great potential of reducing annotation costs. However, there may exist label heterogeneity, i.e., different annotation forms across sites. In this paper, we propose a novel personalized FL framework for medical image segmentation, named FedICRA, which uniformly leverages heterogeneous weak supervision via adaptIve Contrastive Representation and Aggregation. Concretely, to facilitate personalized modeling and to avoid confusion, a channel selection based site contrastive representation module is employed to adaptively cluster intra-site embeddings and separate inter-site ones. To effectively integrate the common knowledge from the global model with the unique knowledge from each local model, an adaptive aggregation module is applied for updating and initializing local models at the element level. Additionally, a weakly supervised objective function that leverages a multiscale tree energy loss and a gated CRF loss is employed to generate more precise pseudo-labels and further boost the segmentation performance. Through extensive experiments on two distinct medical image segmentation tasks of different modalities, the proposed FedICRA demonstrates overwhelming performance over other state-of-the-art personalized FL methods. Its performance even approaches that of fully supervised training on centralized data. Our code and data are available at <a class="link-external link-https" href="https://github.com/llmir/FedICRA" rel="external noopener nofollow">this https URL</a>.

GRACE: A Generalized and Personalized Federated Learning Method for Medical Imaging

FedDGP: Disentangling Global and Personal Models for Federated Learning

MH-pFLGB: Model Heterogeneous personalized Federated Learning via Global Bypass for Medical Image Analysis

Personalized Retrogress-Resilient Federated Learning Toward Imbalanced Medical Data

Personalized Retrogress-Resilient Framework for Real-World Medical Federated Learning

GPFL: Simultaneously Learning Global and Personalized Feature Information for Personalized Federated Learning

Unifying and Personalizing Weakly-supervised Federated Medical Image Segmentation via Adaptive Representation and Aggregation

pFLFE: Cross-silo Personalized Federated Learning via Feature Enhancement on Medical Image Segmentation

Privacy-Preserving Constrained Domain Generalization via Gradient Alignment

Personalized Federated Learning with Adaptive Batchnorm for Healthcare

Bilateral Proxy Federated Domain Generalization for Privacy-preserving Medical Image Diagnosis

Medical Federated Model with Mixture of Personalized and Shared Components

Medical federated learning with joint graph purification for noisy label learning

Medical Federated Model with Mixture of Personalized and Sharing Components

A New Perspective to Boost Performance Fairness for Medical Federated Learning

Customized Federated Learning for Multi-Source Decentralized Medical Image Classification

Adapt to Adaptation: Learning Personalization for Cross-Silo Federated Learning

FedGS: Federated Gradient Scaling for Heterogeneous Medical Image Segmentation

Multi-institutional Collaborations for Improving Deep Learning-based Magnetic Resonance Image Reconstruction Using Federated Learning

Privacy Preserving Federated Learning in Medical Imaging with Uncertainty Estimation

FedHealth 2: Weighted Federated Transfer Learning via Batch Normalization for Personalized Healthcare