Federated Semi-supervised Learning for Medical Image Segmentation with intra-client and inter-client Consistency

Yubin Zheng,Peng Tang,Tianjie Ju,Weidong Qiu,Bo Yan

2024-03-19

Abstract:Medical image segmentation plays a vital role in clinic disease diagnosis and medical image analysis. However, labeling medical images for segmentation task is tough due to the indispensable domain expertise of radiologists. Furthermore, considering the privacy and sensitivity of medical images, it is impractical to build a centralized segmentation dataset from different medical institutions. Federated learning aims to train a shared model of isolated clients without local data exchange which aligns well with the scarcity and privacy characteristics of medical data. To solve the problem of labeling hard, many advanced semi-supervised methods have been proposed in a centralized data setting. As for federated learning, how to conduct semi-supervised learning under this distributed scenario is worth investigating. In this work, we propose a novel federated semi-supervised learning framework for medical image segmentation. The intra-client and inter-client consistency learning are introduced to smooth predictions at the data level and avoid confirmation bias of local models. They are achieved with the assistance of a Variational Autoencoder (VAE) trained collaboratively by clients. The added VAE model plays three roles: 1) extracting latent low-dimensional features of all labeled and unlabeled data; 2) performing a novel type of data augmentation in calculating intra-client consistency loss; 3) utilizing the generative ability of itself to conduct inter-client consistency distillation. The proposed framework is compared with other federated semi-supervised or self-supervised learning methods. The experimental results illustrate that our method outperforms the state-of-the-art method while avoiding a lot of computation and communication overhead.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The paper aims to address two major issues in medical image segmentation: 1. **Label Scarcity**: Medical image annotation requires the expertise of radiologists, making it difficult and time-consuming to obtain a large amount of annotated data. 2. **Data Silos**: Due to privacy and sensitivity issues, it is challenging for different medical institutions to share raw data, making it difficult to build a centralized medical image segmentation dataset. To solve these problems, the paper proposes a new Federated Semi-supervised Learning (FSSL) framework. This framework utilizes a Variational Autoencoder (VAE) to extract latent features from both labeled and unlabeled data and smooths the prediction boundaries through intra-client and inter-client data consistency learning, thereby improving segmentation performance. Additionally, this method can achieve better performance than existing methods while reducing computational and communication overhead.

Federated Semi-supervised Learning for Medical Image Segmentation with intra-client and inter-client Consistency

Federated Cross-Incremental Self-Supervised Learning for Medical Image Segmentation

Federated Semi-Supervised Learning Through a Combination of Self and Cross Model Ensembling

Model-Heterogeneous Semi-Supervised Federated Learning for Medical Image Segmentation

Class Imbalanced Medical Image Classification Based on Semi-Supervised Federated Learning

Distributed contrastive learning for medical image segmentation

FedATA: Adaptive Attention Aggregation for Federated Self-supervised Medical Image Segmentation

Inherent Consistent Learning for Accurate Semi-supervised Medical Image Segmentation

Unifying and Personalizing Weakly-supervised Federated Medical Image Segmentation via Adaptive Representation and Aggregation

Decoupled Consistency for Semi-supervised Medical Image Segmentation

Dual-consistency guidance semi-supervised medical image segmentation with low-level detail feature augmentation

Semi-Supervised Medical Image Segmentation Based on Deep Consistent Collaborative Learning

Rethinking Semi-Supervised Federated Learning: How to co-train fully-labeled and fully-unlabeled client imaging data

SemiFed: Semi-supervised Federated Learning with Consistency and Pseudo-Labeling

ACFL: Communication-Efficient Adversarial Contrastive Federated Learning for Medical Image Segmentation

Beyond Low-Dimensional Features: Enhancing Semi-Supervised Medical Image Semantic Segmentation with Advanced Consistency Learning Techniques

FedMix: Mixed Supervised Federated Learning for Medical Image Segmentation

Study of the performance and scalability of federated learning for medical imaging with intermittent clients

Semi-Supervised 3D Medical Image Segmentation Based on Dual-Task Consistent Joint Learning and Task-Level Regularization.

Semi-Supervised Medical Image Segmentation Based on Local Consistency and Volume Constancy

Uncertainty-Guided Mutual Consistency Learning for Semi-Supervised Medical Image Segmentation