CrossMatch: Enhance Semi-Supervised Medical Image Segmentation with Perturbation Strategies and Knowledge Distillation

Bin Zhao,Chunshi Wang,Shuxue Ding
2024-08-07
Abstract:Semi-supervised learning for medical image segmentation presents a unique challenge of efficiently using limited labeled data while leveraging abundant unlabeled data. Despite advancements, existing methods often do not fully exploit the potential of the unlabeled data for enhancing model robustness and accuracy. In this paper, we introduce CrossMatch, a novel framework that integrates knowledge distillation with dual perturbation strategies-image-level and feature-level-to improve the model's learning from both labeled and unlabeled data. CrossMatch employs multiple encoders and decoders to generate diverse data streams, which undergo self-knowledge distillation to enhance consistency and reliability of predictions across varied perturbations. Our method significantly surpasses other state-of-the-art techniques in standard benchmarks by effectively minimizing the gap between training on labeled and unlabeled data and improving edge accuracy and generalization in medical image segmentation. The efficacy of CrossMatch is demonstrated through extensive experimental validations, showing remarkable performance improvements without increasing computational costs. Code for this implementation is made available at <a class="link-external link-https" href="https://github.com/AiEson/CrossMatch.git" rel="external noopener nofollow">this https URL</a>.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to effectively utilize limited labeled data and a large amount of unlabeled data in medical image segmentation to improve the robustness and accuracy of the model. Specifically, the existing semi - supervised learning methods have deficiencies in using unlabeled data and cannot fully tap their potential to enhance model performance. Therefore, this paper proposes a new framework named CrossMatch, which aims to improve the model's learning ability from labeled and unlabeled data by combining knowledge distillation and a two - layer perturbation strategy (image - level and feature - level). CrossMatch generates diverse data streams by using multiple encoders and decoders, and enhances the prediction consistency and reliability of these data streams under different perturbation conditions through self - knowledge distillation. This method can not only significantly outperform other state - of - the - art techniques, but also effectively reduce the gap between labeled data and unlabeled data during the training process without increasing the computational cost, and improve the edge accuracy and generalization ability. In summary, the core problem of this paper is to explore how to use unlabeled data more effectively to improve model performance in medical image segmentation tasks by proposing the CrossMatch framework.