Abstract:Federated cross learning has shown impressive performance in medical image segmentation. However, it encounters the catastrophic forgetting issue caused by data heterogeneity across different clients and is particularly pronounced when simultaneously facing pixelwise label deficiency problem. In this article, we propose a novel federated cross-incremental self-supervised learning method, coined FedCSL, which not only can enable any client in the federation incrementally yet effectively learn from others without inducing knowledge forgetting or requiring massive labeled samples, but also preserve maximum data privacy. Specifically, to overcome the catastrophic forgetting issue, a novel cross-incremental collaborative distillation (CCD) mechanism is proposed, which distills explicit knowledge learned from previous clients to subsequent clients based on secure multiparty computation (MPC). Besides, an effective retrospect mechanism is designed to rearrange the training sequence of clients per round, further releasing the power of CCD by enforcing interclient knowledge propagation. In addition, to alleviate the need of large-scale densely annotated pretraining medical datasets, we also propose a two-stage training framework, in which federated cross-incremental self-supervised pretraining paradigm first extracts robust yet general image-level patterns across multi-institutional data silos via a novel round-robin distributed masked image modeling (MIM) pipeline; then, the resulting visual concepts, e.g., semantics, are transferred to the federated cross-incremental supervised fine-tuning paradigm, favoring various cross-silo medical image segmentation tasks. The experimental results on public datasets demonstrate the effectiveness of the proposed method as well as the consistently superior performance of our method over most state-of-the-art methods quantitatively and qualitatively.

DC2T: Disentanglement-Guided Consolidation and Consistency Training for Semi-Supervised Cross-Site Continual Segmentation

Semi-Supervised Medical Image Segmentation Based on Deep Consistent Collaborative Learning

Decoupled Consistency for Semi-supervised Medical Image Segmentation

Spatial and Semantic Consistency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images

Dual-consistency guidance semi-supervised medical image segmentation with low-level detail feature augmentation

Inherent Consistent Learning for Accurate Semi-supervised Medical Image Segmentation

Weak-to-Strong Consistency Learning for Semisupervised Image Segmentation.

Semi-supervised Domain Adaptive Medical Image Segmentation through Consistency Regularized Disentangled Contrastive Learning

Progressive Learning With Cross-Window Consistency for Semi-Supervised Semantic Segmentation

Multi-Consistency Training for Semi-Supervised Medical Image Segmentation

Self-aware and Cross-Sample Prototypical Learning for Semi-supervised Medical Image Segmentation

Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Segmentation

Dual-Decoder Consistency via Pseudo-Labels Guided Data Augmentation for Semi-Supervised Medical Image Segmentation

C3T: Contrastive Consistency Cross-Network Learning for Semi-Supervised Semantic Segmentation

L2A: Learning Affinity from Attention for Weakly Supervised Continual Semantic Segmentation

All-Around Real Label Supervision: Cyclic Prototype Consistency Learning for Semi-supervised Medical Image Segmentation

Towards Synchronous Memorizability and Generalizability with Site-Modulated Diffusion Replay for Cross-Site Continual Segmentation

Federated Cross-Incremental Self-Supervised Learning for Medical Image Segmentation

Comprehensive Importance-Based Selective Regularization for Continual Segmentation Across Multiple Sites

Discriminative Consistent Domain Generation for Semi-supervised Learning

Dual-scale Enhanced and Cross-generative Consistency Learning for Semi-supervised Medical Image Segmentation