Abstract:Studies on semi-supervised medical image segmentation (SSMIS) have seen fast progress recently. Due to the limited labelled data, SSMIS methods mainly focus on effectively leveraging unlabeled data to enhance the segmentation performance. However, despite their promising performance, current state-of-the-art methods often prioritize integrating complex techniques and loss terms rather than addressing the core challenges of semi-supervised scenarios directly. We argue that the key to SSMIS lies in generating substantial and appropriate prediction disagreement on unlabeled data. To this end, we emphasize the crutiality of data perturbation and model stabilization in semi-supervised segmentation, and propose a simple yet effective approach to boost SSMIS performance significantly, dubbed DPMS. Specifically, we first revisit SSMIS from three distinct perspectives: the data, the model, and the loss, and conduct a comprehensive study of corresponding strategies to examine their effectiveness. Based on these examinations, we then propose DPMS, which adopts a plain teacher-student framework with a standard supervised loss and unsupervised consistency loss. To produce appropriate prediction disagreements, DPMS perturbs the unlabeled data via strong augmentations to enlarge prediction disagreements considerably. On the other hand, using EMA teacher when strong augmentation is applied does not necessarily improve performance. DPMS further utilizes a forwarding-twice and momentum updating strategies for normalization statistics to stabilize the training on unlabeled data effectively. Despite its simplicity, DPMS can obtain new state-of-the-art performance on the public 2D ACDC and 3D LA datasets across various semi-supervised settings, e.g. obtaining a remarkable 22.62% improvement against previous SOTA on ACDC with 5% labels.

Regional Consistency for Semi-Supervised Segmentation of 3D Medical Images

Dual-consistency guidance semi-supervised medical image segmentation with low-level detail feature augmentation

Uncertainty-Guided Mutual Consistency Learning for Semi-Supervised Medical Image Segmentation

Semi-Supervised 3D Medical Image Segmentation Based on Dual-Task Consistent Joint Learning and Task-Level Regularization.

Consistency learning with dynamic weighting and class-agnostic regularization for semi-supervised medical image segmentation

Multi-Consistency Training for Semi-Supervised Medical Image Segmentation

Inherent Consistent Learning for Accurate Semi-supervised Medical Image Segmentation

Dual consistency regularization with subjective logic for semi-supervised medical image segmentation

Curriculum Consistency Learning and Multi-Scale Contrastive Constraint in Semi-Supervised Medical Image Segmentation

SSMD: Semi-Supervised medical image detection with adaptive consistency and heterogeneous perturbation

Rethinking Data Perturbation and Model Stabilization for Semi-supervised Medical Image Segmentation

Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentation

Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation

Learning Cross-Representation Affinity Consistency for Sparsely Supervised Biomedical Instance Segmentation

Triple-task mutual consistency for semi-supervised 3D medical image segmentation

SemSim: Revisiting Weak-to-Strong Consistency from a Semantic Similarity Perspective for Semi-supervised Medical Image Segmentation

VMCC-NET: Uncovering Challenging Regions in Semi-Supervised Medical Image Segmentation with Voxel Mask Based Cyclic-Consistency Network.

Mutually aided uncertainty incorporated Dual Consistency Regularization with Pseudo Label for Semi-Supervised Medical Image Segmentation

Adaptive Bidirectional Displacement for Semi-Supervised Medical Image Segmentation

Semi-supervised Medical Image Segmentation via Feature-perturbed Consistency.

S<SUP>3</SUP>R: Shape and Semantics-Based Selective Regularization for Explainable Continual Segmentation Across Multiple Sites