Abstract:Semi-supervised segmentation is highly significant in 3D medical image segmentation. The typical solutions adopt a teacher-student dual-model architecture, and they constrain the two models' decision consistency on the same segmentation task. However, the scarcity of medical samples can lower the diversity of tasks, reducing the effectiveness of consistency constraint. The issue can further worsen as the weights of the models gradually become synchronized. In this work, we have proposed to construct diverse joint-tasks using masked image modelling for enhancing the reliability of the consistency constraint, and develop a novel architecture consisting of a single teacher but multiple students to enjoy the additional knowledge decoupled from the synchronized weights. Specifically, the teacher and student models 'see' varied randomly-masked versions of an input, and are trained to segment the same targets but reconstruct different missing regions concurrently. Such joint-task of segmentation and reconstruction can have the two learners capture related but complementary features to derive instructive knowledge when constraining their consistency. Moreover, two extra students join the original one to perform an inter-student learning. The three students share the same encoding but different decoding designs, and learn decoupled knowledge by constraining their mutual consistencies, preventing themselves from suboptimally converging to the biased predictions of the dictatorial teacher. Experimental on four medical datasets show that our approach performs better than six mainstream semi-supervised methods. Particularly, our approach achieves at least 0.61% and 0.36% higher Dice and Jaccard values, respectively, than the most competitive approach on our in-house dataset. The code will be released at http://github.com/zxmboshi/DDL.

Shape-Guided Dual Consistency Semi-Supervised Learning Framework for 3-D Medical Image Segmentation

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Semi-Supervised 3D Medical Image Segmentation Using Shape-Guided Dual Consistency Learning

Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images

Unified Feature Consistency of Under-Performing Pixels and Valid Regions for Semi-Supervised Medical Image Segmentation

Dual-consistency guidance semi-supervised medical image segmentation with low-level detail feature augmentation

Semi-supervised Medical Image Segmentation through Dual-task Consistency

Semi-Supervised 3D Medical Image Segmentation Based on Dual-Task Consistent Joint Learning and Task-Level Regularization.

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network with Bilateral Graph Convolution

Combining Contrastive Learning and Shape Awareness for Semi-Supervised Medical Image Segmentation

Dual self-distillation of U-shaped networks for 3D medical image segmentation

Robust Semi-supervised 3D Medical Image Segmentation with Diverse Joint-task Learning and Decoupled Inter-student Learning

Dual Uncertainty-Guided Mixing Consistency for Semi-Supervised 3D Medical Image Segmentation

Shape-aware Multi-task Learning for Semi-supervised 3D Medical Image Segmentation.

Self-supervised learning via inter-modal reconstruction and feature projection networks for label-efficient 3D-to-2D segmentation

Weakly-Supervised 3D Medical Image Segmentation using Geometric Prior and Contrastive Similarity

Triple-task mutual consistency for semi-supervised 3D medical image segmentation

DTSC-Net: Semi-supervised 3D Biomedical Image Segmentation through Dual-Teacher Simplified Consistency.

Inherent Consistent Learning for Accurate Semi-supervised Medical Image Segmentation

Towards Generic Semi-Supervised Framework for Volumetric Medical Image Segmentation

Multi-Consistency Training for Semi-Supervised Medical Image Segmentation