Semi-supervised Domain Adaptive Medical Image Segmentation through Consistency Regularized Disentangled Contrastive Learning

Hritam Basak,Zhaozheng Yin

2023-07-06

Abstract:Although unsupervised domain adaptation (UDA) is a promising direction to alleviate domain shift, they fall short of their supervised counterparts. In this work, we investigate relatively less explored semi-supervised domain adaptation (SSDA) for medical image segmentation, where access to a few labeled target samples can improve the adaptation performance substantially. Specifically, we propose a two-stage training process. First, an encoder is pre-trained in a self-learning paradigm using a novel domain-content disentangled contrastive learning (CL) along with a pixel-level feature consistency constraint. The proposed CL enforces the encoder to learn discriminative content-specific but domain-invariant semantics on a global scale from the source and target images, whereas consistency regularization enforces the mining of local pixel-level information by maintaining spatial sensitivity. This pre-trained encoder, along with a decoder, is further fine-tuned for the downstream task, (i.e. pixel-level segmentation) using a semi-supervised setting. Furthermore, we experimentally validate that our proposed method can easily be extended for UDA settings, adding to the superiority of the proposed strategy. Upon evaluation on two domain adaptive image segmentation tasks, our proposed method outperforms the SoTA methods, both in SSDA and UDA settings. Code is available at <a class="link-external link-https" href="https://github.com/hritam-98/GFDA-disentangled" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition,Artificial Intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to effectively utilize a small amount of labeled target - domain data to improve the cross - domain adaptation performance of the model in medical image segmentation tasks. Specifically, the paper focuses on how to improve the generalization ability of the model through the semi - supervised domain adaptation (SSDA) method when there are large domain differences between the source domain and the target domain. Although traditional unsupervised domain adaptation (UDA) methods can alleviate the domain shift problem, their performance is usually not as good as that of supervised methods. Therefore, this paper proposes a new method that combines consistency regularization and decoupled contrastive learning, aiming to significantly improve the adaptation performance of the model through a small number of labeled samples in the target domain. This method is not only applicable to SSDA scenarios, but can also be extended to UDA scenarios, and shows better performance than the existing state - of - the - art methods in two different domain - adaptation segmentation tasks.