Enhancing Semi-Supervised Medical Image Segmentation with Bidirectional Copy-Paste and Masked Image Reconstruction

Xixuan Yu,Qinghe Ma,Tong Ling,Jiewen Zhu,Yinghuan Shi
DOI: https://doi.org/10.1007/s13042-024-02410-1
2024-01-01
International Journal of Machine Learning and Cybernetics
Abstract:To avoid the time-consuming and specialized task of medical image annotation, semi-supervised medical image segmentation methods encourage models to leverage large amounts of unlabeled data for training, which plays a crucial role in real-world medical scenarios. However, existing semi-supervised medical image segmentation methods often rely on data augmentation and pseudo-labeling techniques, overlooking the model’s perception of the relatively fixed structural information in medical images. Consequently, the segmentation results remain suboptimal. We propose integrating the Masked Autoencoders (MAE) method into the Bidirectional Copy-Paste (BCP) framework to address this challenge. Specifically, we randomly mask medical images and introduce an additional image reconstruction task in semi-supervised medical image segmentation to enhance the model encoder’s understanding and perception of image structures. We conducted experiments on the LA dataset and ACDC dataset. Experimental results show that our approach significantly outperforms state-of-the-art semi-supervised medical image segmentation methods, achieving notable improvements on various datasets (e.g., over 1.2 % Dice improvement on ACDC dataset).
What problem does this paper attempt to address?