Abstract:Scribble-supervised medical image segmentation tackles the limitation of sparse masks. Conventional approaches alternate between: labeling pseudo-masks and optimizing network parameters. However, such iterative two-stage paradigm is unwieldy and could be trapped in poor local optima since the networks undesirably regress to the erroneous pseudo-masks. To address these issues, we propose a non-iterative method where a stream of varying (pacing) pseudo-masks teach a network via consistency training, named PacingPseudo. Our contributions are summarized as follows. First, we design a non-iterative process. This process is achieved gracefully by a siamese architecture that comprises two weight-sharing networks. The siamese architecture naturally allows a stream of pseudo-masks to assimilate a stream of predicted-masks during training. Second, we make the consistency training effective with two necessary designs: (i) entropy regularization to obtain high-confidence pseudo-masks for effective teaching; and (ii) distorted augmentations to create discrepancy between the pseudo-mask and predicted-mask streams for consistency regularization. Third, we devise a new memory bank mechanism that provides an extra source of ensemble features to complement scarce labeled pixels. We evaluate the proposed PacingPseudo on public abdominal organ, cardiac structure , and myocardium datasets, named CHAOS T1&T2, ACDC, and LVSC. Evaluation metrics include the Dice similarity coefficient (DSC) and the 95th percentile of Hausdorff distance (HD95). Experimental results show that PacingPseudo achieves a 68.0% DSC and 14.1 mm HD95 on CHAOS T1, 73.7% DSC and 12.2 mm HD95 on CHAOS T2, 82.9% DSC and 4.3 mm HD95 on ACDC, and 61.4% DSC and 11.9 mm HD95 on LVSC. These results improve the baseline method by ≥ 3.1% in DSC and ≥ 14.2 mm in HD95. These results also outcompete previous methods. The fully-supervised method attains a 67.0% DSC and 16.7 mm HD95 on CHAOS T1, 71.2% DSC and 12.6 mm HD95 on CHAOS T2, 84.0% DSC and 3.9 mm HD95 on ACDC, and 72.9% DSC and 7.6 mm HD95 on LVSC. PacingPseudo's performance is comparable to the fully-supervised method on CHAOS T1&T2 and ACDC. Overall, the above results demonstrate the feasibility of PacingPseudo for the challenging scribble-supervised segmentation tasks. The source code is publicly available at https://github.com/zefanyang/pacingpseudo .

Weakly Supervised Medical Image Segmentation Via Superpixel-Guided Scribble Walking and Class-Wise Contrastive Regularization.

Scribble-Supervised Segmentation of Aerial Building Footprints Using Adversarial Learning

ScribSD+: Scribble-supervised medical image segmentation based on simultaneous multi-scale knowledge distillation and class-wise contrastive regularization

DMSPS: Dynamically mixed soft pseudo-label supervision for scribble-supervised medical image segmentation

ScribbleVS: Scribble-Supervised Medical Image Segmentation via Dynamic Competitive Pseudo Label Selection

ZScribbleSeg: Zen and the Art of Scribble Supervised Medical Image Segmentation

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

Embarrassingly Simple Scribble Supervision for 3D Medical Segmentation

Size Aware Cross-shape Scribble Supervision for Medical Image Segmentation

Non-iterative scribble-supervised learning with pacing pseudo-masks for medical image segmentation

CC4S: Encouraging Certainty and Consistency in Scribble-Supervised Semantic Segmentation

Weakly‐supervised structural component segmentation via scribble annotations

Scribble Hides Class: Promoting Scribble-Based Weakly-Supervised Semantic Segmentation with Its Class Label

Sribble Supervised Multimodal Medical Image Segmentation

PCLMix: Weakly Supervised Medical Image Segmentation via Pixel-Level Contrastive Learning and Dynamic Mix Augmentation

Semi-Supervised Medical Image Segmentation Based on Deep Consistent Collaborative Learning

Optimal Scale of Hierarchical Image Segmentation with Scribbles Guidance for Weakly Supervised Semantic Segmentation

Self-supervised Contrastive Learning with Random Walks for Medical Image Segmentation with limited Annotations

Segment Anything Model-guided Collaborative Learning Network for Scribble-supervised Polyp Segmentation

ProCNS: Progressive Prototype Calibration and Noise Suppression for Weakly-Supervised Medical Image Segmentation

Segmentation only uses sparse annotations: Unified weakly and semi-supervised learning in medical images