Triple Consistency-based Self-ensembling Model for Unsupervised Domain Adaption in Medical Image Segmentation

Andrew Shi,Wei Feng
DOI: https://doi.org/10.1109/IJCNN54540.2023.10192037
2023-06-18
Abstract:Deep learning models typically suffer significant performance degradation when they are applied directly to an unseen new dataset with a distribution inconsistent with the training data. Unsupervised domain adaptation allows models to generalize better on new data by learning domain shared feature representations to narrow the domain distribution differences. In this paper, we propose a new triple consistency-based self-ensembling model for unsupervised domain adaptation in medical image segmentation. We first propose a Fourier transform-based data augmentation method for generating semantic-preserving cross-domain augmented images, which can be easily incorporated into model training with only a small computational cost. Then we input the source domain image, target domain image and cross-domain augmented image into the self-ensembling model, and then propose three consistency strategies to guarantee the consistency of the original semantic information in the target domain from the output level, structure level and class level, respectively, penalizing the inconsistent prediction of the segmentation network, thus providing additional supervised signals to the segmentation model and improving the generalization performance of the model on the target domain data. We have conducted extensive experiments on a cross-modality cardiac structure segmentation dataset, and the experimental results show that our approach is significantly better than the state-of-the-art comparison algorithms. Our code will be released soon.
Computer Science
What problem does this paper attempt to address?