Abstract:Background and objective:Abundant labeled data drives the model training for better performance, but collecting sufficient labels is still challenging. To alleviate the pressure of label collection, semi-supervised learning merges unlabeled data into training process. However, the joining of unlabeled data (e.g., data from different hospitals with different acquisition parameters) will change the original distribution. Such a distribution shift leads to a perturbation in the training process, potentially leading to a confirmation bias. In this paper, we investigate distribution shift and develop methods to increase the robustness of our models, with the goal of improving performance in semi-supervised semantic segmentation of medical images. We study distribution shift and increase model robustness to it, for improving practical performance in semi-supervised segmentation over medical images.Methods:To alleviate the issue of distribution shift, we introduce adversarial training into the co-training process. We simulate perturbations caused by the distribution shift via adversarial perturbations and introduce the adversarial perturbation to attack the supervised training to improve the robustness against the distribution shift. Benefiting from label guidance, supervised training does not collapse under adversarial attacks. For co-training, two sub-models are trained from two views (over two disjoint subsets of the dataset) to extract different kinds of knowledge independently. Co-training outperforms single-model by integrating both views of knowledge to avoid confirmation bias.Results:For practicality, we conduct extensive experiments on challenging medical datasets. Experimental results show desirable improvements to state-of-the-art counterparts (Yu and Wang, 2019; Peng et al., 2020; Perone et al., 2019). We achieve a DSC score of 87.37% with only 20% of labels on the ACDC dataset, almost same to using 100% of labels. On the SCGM dataset with more distribution shift, we achieve a DSC score of 78.65% with 6.5% of labels, surpassing 10.30% over Peng et al. (2020). Our evaluative results show superior robustness against distribution shifts in medical scenarios.Conclusion:Empirical results show the effectiveness of our work for handling distribution shift in medical scenarios.

Cross-adversarial local distribution regularization for semi-supervised medical image segmentation

Adversarial co-training for semantic segmentation over medical images

Semi-Supervised Medical Image Segmentation with Co-Distribution Alignment

Cross-denoising Network against Corrupted Labels in Medical Image Segmentation with Domain Shift

Semi-supervised Medical Image Segmentation with Distribution Calibration and Non-local Semantic Constraint.

Mind the Gap: Alleviating Local Imbalance for Unsupervised Cross-Modality Medical Image Segmentation.

Semi-Supervised 3D Medical Image Segmentation Based on Dual-Task Consistent Joint Learning and Task-Level Regularization.

Unsupervised Local Discrimination for Medical Images

Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Segmentation

Exploring Smoothness and Class-Separation for Semi-supervised Medical Image Segmentation

Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective

Semi-supervised Medical Image Segmentation Method Based on Cross-pseudo Labeling Leveraging Strong and Weak Data Augmentation Strategies

Dual-consistency guidance semi-supervised medical image segmentation with low-level detail feature augmentation

Robust Semi-supervised Multimodal Medical Image Segmentation via Cross Modality Collaboration

Semi-supervised medical image segmentation with diverse views via cross-pseudo supervision

Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Model

Cross-View Mutual Learning for Semi-Supervised Medical Image Segmentation

ACCL: Adversarial Constrained-Cnn Loss for Weakly Supervised Medical Image Segmentation

Cross-Modality Medical Image Segmentation via Enhanced Feature Alignment and Cross Pseudo Supervision Learning

Deep Mutual Distillation for Semi-supervised Medical Image Segmentation

PCDAL: A Perturbation Consistency-Driven Active Learning Approach for Medical Image Segmentation and Classification