Abstract:Background and objective: Deep learning-based methods for fast target segmentation of magnetic resonance imaging (MRI) have become increasingly popular in recent years. Generally, the success of deep learning methods in medical image segmentation tasks relies on a large amount of labeled data. The time-consuming and labor-intensive problem of data annotation is a major challenge in medical image segmentation tasks. The aim of this work is to enhance the segmentation of MR images using a semi-supervised learning-based method using a small amount of labeled data and a large amount of unlabeled data. Methods: To utilize the effective information of the unlabeled data, we designed the method of guiding the Student segmentation model simultaneously by the Dual-Teacher structure of CNN and transformer forming the subject network. Both Teacher A and Student models are CNNs, and the TA-S module they form is a mean teacher structure with added data noise. In the TB-S module formed by the combination of Student and Teacher B models, their backbone networks CNN and transformer capture the local and global information of the image at the same time, respectively, to create pseudo labels for each other and perform cross-supervision. The Dual-Teacher guides the Student through synchronous training and performs knowledge rectification and communication with each other through consistent regular constraints, which better utilizes the valid information in the unlabeled data. In addition, the segmentation predictions of Teacher A and Student and Teacher A and Teacher B are screened for uncertainty assessment during the training process to enhance the prediction accuracy and generalization of the model. This method uses the mechanism of simultaneous training of the synthetic structure composed of TA-S and TB-S modules to jointly guide the optimization of the Student model to obtain better segmentation ability. Results: We evaluated the proposed method on a publicly available MRI dataset from a cardiac segmentation competition organized by MICCAI in 2017. Compared with several existing state-of-the-art semi-supervised segmentation methods, the method achieves better segmentation results in terms of Dice coefficient and HD distance evaluation metrics of 0.878 and 4.9 mm and 0.886 and 5.0 mm, respectively, using a training set containing only 10% and 20% of labeled data. Conclusion: This method fuses CNN and transformer to design a new Teacher-Student semi-supervised learning optimization strategy, which greatly improves the utilization of a large number of unlabeled medical images and the effectiveness of model segmentation results. (C) 2022 Elsevier B.V. All rights reserved.

CTSSeg: Consistent Teacher-Student model for magnetic resonance image Segmentation

Segmentation of Cardiac Tissues and Organs for CCTA Images Based on a Deep Learning Model

MedFCT: A Frequency Domain Joint CNN-Transformer Network for Semi-supervised Medical Image Segmentation

Constantly optimized mean teacher for semi-supervised 3D MRI image segmentation

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

MTANS: Multi-Scale Mean Teacher Combined Adversarial Network with Shape-Aware Embedding for Semi-Supervised Brain Lesion Segmentation

Efficient Combination of CNN and Transformer for Dual-Teacher Uncertainty-guided Semi-supervised Medical Image Segmentation

MTSegNet: Semi-supervised Abdominal Organ Segmentation in CT

A Teacher-Student Framework for Semi-supervised Medical Image Segmentation From Mixed Supervision

Competitive Ensembling Teacher-Student Framework for Semi-Supervised Left Atrium MRI Segmentation

Semi-Supervised Brain Lesion Segmentation With An Adapted Mean Teacher Model

Multi-Consistency Training for Semi-Supervised Medical Image Segmentation

LESEN: Label-Efficient deep learning for Multi-parametric MRI-based Visual Pathway Segmentation

Semi-supervised segmentation of cardiac chambers from LGE-CMR using feature consistency awareness

DSST: A Dual Student Model Guided Student–teacher Framework for Semi-Supervised Medical Image Segmentation

CM-SegNet: A Deep Learning-Based Automatic Segmentation Approach for Medical Images by Combining Convolution and Multilayer Perceptron

Hierarchical Consistency Regularized Mean Teacher for Semi-supervised 3D Left Atrium Segmentation

A3DSegNet: Anatomy-Aware Artifact Disentanglement and Segmentation Network for Unpaired Segmentation, Artifact Reduction, and Modality Translation

A$^3$DSegNet: Anatomy-aware artifact disentanglement and segmentation network for unpaired segmentation, artifact reduction, and modality translation

Few-Sample Multi-Organ Abdominal Image Segmentation With Mean Teacher Model

Pseudo-3D Network for Multi-sequence Cardiac MR Segmentation