Abstract:Source-free test-time adaptation for medical image segmentation aims to enhance the adaptability of segmentation models to diverse and previously unseen test sets of the target domain, which contributes to the generalizability and robustness of medical image segmentation models without access to the source domain. Ensuring consistency between target edges and paired inputs is crucial for test-time adaptation. To improve the performance of test-time domain adaptation, we propose a multi task consistency guided source-free test-time domain adaptation medical image segmentation method which ensures the consistency of the local boundary predictions and the global prototype representation. Specifically, we introduce a local boundary consistency constraint method that explores the relationship between tissue region segmentation and tissue boundary localization tasks. Additionally, we propose a global feature consistency constraint toto enhance the intra-class compactness. We conduct extensive experiments on the segmentation of benchmark fundus images. Compared to prediction directly by the source domain model, the segmentation Dice score is improved by 6.27\% and 0.96\% in RIM-ONE-r3 and Drishti GS datasets, respectively. Additionally, the results of experiments demonstrate that our proposed method outperforms existing competitive domain adaptation segmentation algorithms.

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper aims to address the issue of Source-Free Test-Time Domain Adaptation (SFTTA) in medical image segmentation. Specifically, the researchers seek to enhance the adaptability of segmentation models to diverse and unseen test sets in the target domain without accessing source domain data, thereby improving the generalization ability and robustness of medical image segmentation models. ### Background and Challenges In typical clinical environments, source domain data is often unavailable, and obtaining a large training set from the target domain to adapt the source model may be impractical. Therefore, adaptation can only be performed on a small number (or even a single) of test images in the target domain. Additionally, there are still distribution differences between source and target data, as well as between different test samples in the target domain. These differences may be caused by changes in imaging protocols, parameter variations within the same protocol, inherent hardware differences between different machines, and fluctuations in the signal-to-noise ratio within the same machine. When using an unlabeled target domain training set for domain adaptation, model performance may decline due to the distribution gap between the training set and the test set. Therefore, the SFTTA problem becomes more challenging and has garnered significant attention from researchers in the absence of source data and target domain training sets. ### Solution To address this challenge, the researchers proposed a Multi Task Consistency Guided Source-Free Test-Time Domain Adaptation (MCDA) method for medical image segmentation. This method ensures the consistency of local boundary predictions and global prototype representations by mining the local boundary information and global semantic representations of test samples, thereby enhancing the model's adaptability and segmentation performance on the target domain test set. ### Main Contributions 1. **Framework Design**: A multi-task consistency guided source-free test-time domain adaptation framework for medical image segmentation is proposed, which mines the local boundary information and global semantic representations of test samples online. 2. **Boundary Consistency Constraint**: A boundary consistency constraint method is introduced to explore the relationship between tissue region segmentation and tissue boundary localization tasks. 3. **Global Feature Consistency Constraint**: A target prototype consistency constraint is introduced to guide the model to focus on the target regions in the image, improving the model's segmentation performance and adaptability to different contextual information in the target domain. 4. **Experimental Validation**: Experiments were conducted on 3 public fundus image datasets, and the results show that the proposed method outperforms existing state-of-the-art SFTTA methods without source data. ### Conclusion The MCDA method proposed in this paper provides a new solution for the application of source-free test-time domain adaptation in the field of medical image segmentation, with significant theoretical and practical implications.

Multi Task Consistency Guided Source-Free Test-Time Domain Adaptation Medical Image Segmentation

Fully Test-Time Adaptation for Image Segmentation

Improving cross-domain generalizability of medical image segmentation using uncertainty and shape-aware continual test-time domain adaptation

Dual consistent pseudo label generation for multi-source domain adaptation without source data for medical image segmentation

Test-time Bi-directional Adaptation between Image and Model for Robust Segmentation

DG-TTA: Out-of-domain medical image segmentation through Domain Generalization and Test-Time Adaptation

A multi-task unsupervised domain adaptation network for medical image segmentation

Test-Time Adaptation with Shape Moments for Image Segmentation

SATTA: Semantic-Aware Test-Time Adaptation for Cross-Domain Medical Image Segmentation

Style Consistency Unsupervised Domain Adaptation Medical Image Segmentation

Edge-Guided Output Adaptor: Highly Efficient Adaptation Module for Cross-Vendor Medical Image Segmentation.

Tri-Directional Tasks Complementary Learning for Unsupervised Domain Adaptation of Cross-modality Medical Image Semantic Segmentation.

Triple Consistency-based Self-ensembling Model for Unsupervised Domain Adaption in Medical Image Segmentation

Mind the Gap: Alleviating Local Imbalance for Unsupervised Cross-Modality Medical Image Segmentation.

Multi-Source Domain Adaptation for Medical Image Segmentation.

Unsupervised Domain Adaptation for Medical Image Segmentation by Selective Entropy Constraints and Adaptive Semantic Alignment

Gradient Alignment Improves Test-Time Adaptation for Medical Image Segmentation

Day-Night Adaptation: An Innovative Source-free Adaptation Framework for Medical Image Segmentation

Towards collaborative appearance and semantic adaptation for medical image segmentation

Towards Clinician-Preferred Segmentation: Leveraging Human-in-the-Loop for Test Time Adaptation in Medical Image Segmentation

Triple-task mutual consistency for semi-supervised 3D medical image segmentation