Abstract:Semi-supervised segmentation is highly significant in 3D medical image segmentation. The typical solutions adopt a teacher-student dual-model architecture, and they constrain the two models' decision consistency on the same segmentation task. However, the scarcity of medical samples can lower the diversity of tasks, reducing the effectiveness of consistency constraint. The issue can further worsen as the weights of the models gradually become synchronized. In this work, we have proposed to construct diverse joint-tasks using masked image modelling for enhancing the reliability of the consistency constraint, and develop a novel architecture consisting of a single teacher but multiple students to enjoy the additional knowledge decoupled from the synchronized weights. Specifically, the teacher and student models 'see' varied randomly-masked versions of an input, and are trained to segment the same targets but reconstruct different missing regions concurrently. Such joint-task of segmentation and reconstruction can have the two learners capture related but complementary features to derive instructive knowledge when constraining their consistency. Moreover, two extra students join the original one to perform an inter-student learning. The three students share the same encoding but different decoding designs, and learn decoupled knowledge by constraining their mutual consistencies, preventing themselves from suboptimally converging to the biased predictions of the dictatorial teacher. Experimental on four medical datasets show that our approach performs better than six mainstream semi-supervised methods. Particularly, our approach achieves at least 0.61% and 0.36% higher Dice and Jaccard values, respectively, than the most competitive approach on our in-house dataset. The code will be released at http://github.com/zxmboshi/DDL.

Effects of lorazepam on the distribution of spatial attention.

Semi-Supervised Convolutional Vision Transformer with Bi-Level Uncertainty Estimation for Medical Image Segmentation

Maximum rates of frequency scanning and mechanical or electronic stirring for distortionless signal generation inside electromagnetic reverberation chambers

Robust Semi-supervised 3D Medical Image Segmentation with Diverse Joint-task Learning and Decoupled Inter-student Learning

Enhanced synthesis of adrenal dopamine beta-hydroxylase induced by repeated immobilization in rats.

Mutually aided uncertainty incorporated Dual Consistency Regularization with Pseudo Label for Semi-Supervised Medical Image Segmentation

Uncertainty-Guided Mutual Consistency Learning for Semi-Supervised Medical Image Segmentation

Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation

Uncertainty teacher with dense focal loss for semi-supervised medical image segmentation

Uncertainty-aware pseudo-label and consistency for semi-supervised medical image segmentation

Dual-Task Mutual Learning for Semi-Supervised Medical Image Segmentation

Triple-task mutual consistency for semi-supervised 3D medical image segmentation

Semisupervised Medical Image Segmentation through Prototype-Based Mutual Consistency Learning

The student-teacher framework guided by self-training and consistency regularization for semi-supervised medical image segmentation

A Teacher-Student Framework for Semi-supervised Medical Image Segmentation From Mixed Supervision

Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation

Hybrid dual mean-teacher network with double-uncertainty guidance for semi-supervised segmentation of magnetic resonance images

Constantly optimized mean teacher for semi-supervised 3D MRI image segmentation

Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation

Re: Dickson HG. Re: Dickson's problems with the ICIDH definition of impairment. Disability and Rehabilitation 1997; 19, 122-123.

Dual Uncertainty-Guided Mixing Consistency for Semi-Supervised 3D Medical Image Segmentation