Abstract:Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated learning (FL) can learn a shared model from decentralized data. But traditional FL requires fully-labeled data for training, which is very expensive to obtain. Self-supervised contrastive learning (CL) can learn from unlabeled data for pre-training, followed by fine-tuning with limited annotations. However, when adopting CL in FL, the limited data diversity on each site makes federated contrastive learning (FCL) ineffective. In this work, we propose two federated self-supervised learning frameworks for volumetric medical image segmentation with limited annotations. The first one features high accuracy and fits high-performance servers with high-speed connections. The second one features lower communication costs, suitable for mobile devices. In the first framework, features are exchanged during FCL to provide diverse contrastive data to each site for effective local CL while keeping raw data private. Global structural matching aligns local and remote features for a unified feature space among different sites. In the second framework, to reduce the communication cost for feature exchanging, we propose an optimized method FCLOpt that does not rely on negative samples. To reduce the communications of model download, we propose the predictive target network update (PTNU) that predicts the parameters of the target network. Based on PTNU, we propose the distance prediction (DP) to remove most of the uploads of the target network. Experiments on a cardiac MRI dataset show the proposed two frameworks substantially improve the segmentation and generalization performance compared with state-of-the-art techniques.

A Multimodal Contrastive Federated Learning for Digital Healthcare

Multimodal Federated Learning in Healthcare: a Review

A Federated Learning Framework Via Decentralized Data Valuation for Chronic Disease Healthcare

Multimodal Federated Learning via Contrastive Representation Ensemble

Distributed contrastive learning for medical image segmentation

Unified Fair Federated Learning for Digital Healthcare

A unified framework for multi-modal federated learning

FedCL: Federated Contrastive Learning for Multi-center Medical Image Classification

Federated learning: Applications, challenges and future directions

FedMM: Federated Multi-Modal Learning with Modality Heterogeneity in Computational Pathology

Framework for Co-distillation Driven Federated Learning to Address Class Imbalance in Healthcare

Federated learning based futuristic biomedical big-data analysis and standardization

Federated Learning for Healthcare: Systematic Review and Architecture Proposal

Medical Imaging Applications of Federated Learning

Federated Learning for Data and Model Heterogeneity in Medical Imaging

Towards Fair and Privacy Preserving Federated Learning for the Healthcare Domain

A Scalable Federated Learning Approach for Collaborative Smart Healthcare Systems with Intermittent Clients using Medical Imaging

Federated Learning for Time-Series Healthcare Sensing with Incomplete Modalities

Contrastive Learning on Multimodal Analysis of Electronic Health Records

FedMultimodal: A Benchmark for Multimodal Federated Learning