Constantly optimized mean teacher for semi-supervised 3D MRI image segmentation

Ning Li,Yudong Pan,Wei Qiu,Lianjin Xiong,Yaobin Wang,Yangsong Zhang

DOI: https://doi.org/10.1007/s11517-024-03061-8

2024-06-21

Medical & Biological Engineering & Computing

Abstract:The mean teacher model and its variants, as important methods in semi-supervised learning, have demonstrated promising performance in magnetic resonance imaging (MRI) data segmentation. However, the superior performance of teacher model through exponential moving average (EMA) is limited by the unreliability of unlabeled image, resulting in potentially unreliable predictions. In this paper, we propose a framework to optimized the teacher model with reliable expert-annotated data while preserving the advantages of EMA. To avoid the tight coupling that results from EMA, we leverage data augmentations to provide two distinct perspectives for the teacher and student models. The teacher model adopts weak data augmentation to provide supervision for the student model and optimizes itself with real annotations, while the student uses strong data augmentation to avoid overfitting on noise information. In addition, double softmax helps the model resist noise and continue learning meaningful information from the images, which is a key component in the proposed model. Extensive experiments show that the proposed method exhibits competitive performance on the Left Atrium segmentation MRI dataset (LA) and the Brain Tumor Segmentation MRI dataset (BraTS2019). For the LA dataset, we achieved a dice of 91.02% using only 20% labeled data, which is close to the dice of 91.14% obtained by the supervised approach using 100% labeled data. For the BraTs2019 dataset, the proposed method achieved 1.02% and 1.92% improvement on 5% and 10% labeled data, respectively, compared to the best baseline method on this dataset. This study demonstrates that the proposed model can be a potential candidate for medical image segmentation in semi-supervised learning scenario.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,medical informatics

What problem does this paper attempt to address?

This paper mainly discusses the semi-supervised learning method in medical image segmentation, especially for the segmentation of 3D MRI (Magnetic Resonance Imaging) images. The existing Mean Teacher model may be limited by unreliable predictions when utilizing unlabeled data. To address this issue, the paper proposes a Constantly Optimized Mean Teacher (COMT) model, aiming to improve the Mean Teacher model by utilizing reliable expert-annotated data and avoiding overfitting noise information through different data augmentation strategies.

In this framework, the teacher model not only shares parameters with the student model through Exponential Moving Average (EMA), but also utilizes real labeled data for optimization to provide more reliable predictions. Meanwhile, to tackle the tight coupling between the teacher and student models, the paper adopts MRI-specific data augmentation techniques to provide different input perspectives for the teacher and student models. Weak data augmentation is used for the teacher model with labeled data, while strong data augmentation is employed for the student model to prevent overfitting. Additionally, the model utilizes a dual softmax to combat noise and continuously learns meaningful information from the images.

Experimental results demonstrate that this method achieves comparable performance to fully supervised methods on the Left Atrium segmentation MRI dataset (LA) and Brain Tumor Segmentation MRI dataset (BraTS2019), especially with a small amount of labeled data. It outperforms other baseline methods, showcasing the potential of this model in the semi-supervised learning scenario.