Abstract:Semi-supervised segmentation is highly significant in 3D medical image segmentation. The typical solutions adopt a teacher-student dual-model architecture, and they constrain the two models' decision consistency on the same segmentation task. However, the scarcity of medical samples can lower the diversity of tasks, reducing the effectiveness of consistency constraint. The issue can further worsen as the weights of the models gradually become synchronized. In this work, we have proposed to construct diverse joint-tasks using masked image modelling for enhancing the reliability of the consistency constraint, and develop a novel architecture consisting of a single teacher but multiple students to enjoy the additional knowledge decoupled from the synchronized weights. Specifically, the teacher and student models 'see' varied randomly-masked versions of an input, and are trained to segment the same targets but reconstruct different missing regions concurrently. Such joint-task of segmentation and reconstruction can have the two learners capture related but complementary features to derive instructive knowledge when constraining their consistency. Moreover, two extra students join the original one to perform an inter-student learning. The three students share the same encoding but different decoding designs, and learn decoupled knowledge by constraining their mutual consistencies, preventing themselves from suboptimally converging to the biased predictions of the dictatorial teacher. Experimental on four medical datasets show that our approach performs better than six mainstream semi-supervised methods. Particularly, our approach achieves at least 0.61% and 0.36% higher Dice and Jaccard values, respectively, than the most competitive approach on our in-house dataset. The code will be released at http://github.com/zxmboshi/DDL.

MMSeg: A novel multi-task learning framework for class imbalance and label scarcity in medical image segmentation

MsVRL: Self-Supervised Multiscale Visual Representation Learning Via Cross-Level Consistency for Medical Image Segmentation

Weakly-Interactive-Mixed Learning: Less Labelling Cost for Better Medical Image Segmentation.

An Efficient Semi-Supervised Framework with Multi-Task and Curriculum Learning for Medical Image Segmentation

Multi-task contrastive learning for semi-supervised medical image segmentation with multi-scale uncertainty estimation

MRL-Seg: Overcoming Imbalance in Medical Image Segmentation With Multi-Step Reinforcement Learning

Robust Semi-supervised Multimodal Medical Image Segmentation via Cross Modality Collaboration

Dual-Task Mutual Learning for Semi-Supervised Medical Image Segmentation

Self-Supervised, Semi-Supervised, Multi-Context Learning for the Combined Classification and Segmentation of Medical Images (student Abstract)

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

Multi-Level Contrastive Student-Teacher Structure for Semi-Supervised Medical Image Segmentation

Weakly supervised learning for multi-class medical image segmentation via feature decomposition

Multi-task Attention-Based Semi-supervised Learning for Medical Image Segmentation

Semisupervised Medical Image Segmentation through Prototype-Based Mutual Consistency Learning

Robust Semi-supervised 3D Medical Image Segmentation with Diverse Joint-task Learning and Decoupled Inter-student Learning

Versatile Medical Image Segmentation Learned from Multi-Source Datasets via Model Self-Disambiguation

Multi-modal contrastive mutual learning and pseudo-label re-learning for semi-supervised medical image segmentation

Consistency-guided Meta-Learning for Bootstrapping Semi-Supervised Medical Image Segmentation

Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation

Segment Together: A Versatile Paradigm for Semi-Supervised Medical Image Segmentation

Semi-supervised medical image segmentation via a tripled-uncertainty guided mean teacher model with contrastive learning