Abstract:Federated cross learning has shown impressive performance in medical image segmentation. However, it encounters the catastrophic forgetting issue caused by data heterogeneity across different clients and is particularly pronounced when simultaneously facing pixelwise label deficiency problem. In this article, we propose a novel federated cross-incremental self-supervised learning method, coined FedCSL, which not only can enable any client in the federation incrementally yet effectively learn from others without inducing knowledge forgetting or requiring massive labeled samples, but also preserve maximum data privacy. Specifically, to overcome the catastrophic forgetting issue, a novel cross-incremental collaborative distillation (CCD) mechanism is proposed, which distills explicit knowledge learned from previous clients to subsequent clients based on secure multiparty computation (MPC). Besides, an effective retrospect mechanism is designed to rearrange the training sequence of clients per round, further releasing the power of CCD by enforcing interclient knowledge propagation. In addition, to alleviate the need of large-scale densely annotated pretraining medical datasets, we also propose a two-stage training framework, in which federated cross-incremental self-supervised pretraining paradigm first extracts robust yet general image-level patterns across multi-institutional data silos via a novel round-robin distributed masked image modeling (MIM) pipeline; then, the resulting visual concepts, e.g., semantics, are transferred to the federated cross-incremental supervised fine-tuning paradigm, favoring various cross-silo medical image segmentation tasks. The experimental results on public datasets demonstrate the effectiveness of the proposed method as well as the consistently superior performance of our method over most state-of-the-art methods quantitatively and qualitatively.

Federated Incremental Semantic Segmentation

No One Left Behind: Real-World Federated Class-Incremental Learning

Gradient-Semantic Compensation for Incremental Semantic Segmentation

FedSeg: Class-Heterogeneous Federated Learning for Semantic Segmentation

Foundation Model Drives Weakly Incremental Learning for Semantic Segmentation

Endpoints Weight Fusion for Class Incremental Semantic Segmentation

EndpointsWeight Fusion for Class Incremental Semantic Segmentation

Class-Incremental Learning for Semantic Segmentation in Aerial Imagery Via Distillation in All Aspects

Memory-Based Contrastive Learning with Optimized Sampling for Incremental Few-Shot Semantic Segmentation

Memory-guided Network with Uncertainty-based Feature Augmentation for Few-shot Semantic Segmentation

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

Overcoming Spatial-Temporal Catastrophic Forgetting for Federated Class-Incremental Learning

Class Balanced Adaptive Pseudo Labeling for Federated Semi-Supervised Learning

Dmaf: Data-Model Anti-Forgetting for Federated Incremental Learning

Causes of Catastrophic Forgetting in Class-Incremental Semantic Segmentation

Heterogeneous Forgetting Compensation for Class-Incremental Learning

Class-Incremental Semantic Segmentation of Aerial Images Via Pixel-Level Feature Generation and Task-Wise Distillation

Accurate Forgetting for Heterogeneous Federated Continual Learning

MiSSNet: Memory-Inspired Semantic Segmentation Augmentation Network for Class-Incremental Learning in Remote Sensing Images

Federated Cross-Incremental Self-Supervised Learning for Medical Image Segmentation

Inherit With Distillation and Evolve With Contrast: Exploring Class Incremental Semantic Segmentation Without Exemplar Memory