Abstract:Applying pre-trained medical segmentation models on out-of-domain images often yields predictions of insufficient quality. Several strategies have been proposed to maintain model performance, such as finetuning or unsupervised- and source-free domain adaptation. These strategies set restrictive requirements for data availability. In this study, we propose to combine domain generalization and test-time adaptation to create a highly effective approach for reusing pre-trained models in unseen target domains. Domain-generalized pre-training on source data is used to obtain the best initial performance in the target domain. We introduce the MIND descriptor previously used in image registration tasks as a further technique to achieve generalization and present superior performance for small-scale datasets compared to existing approaches. At test-time, high-quality segmentation for every single unseen scan is ensured by optimizing the model weights for consistency given different image augmentations. That way, our method enables separate use of source and target data and thus removes current data availability barriers. Moreover, the presented method is highly modular as it does not require specific model architectures or prior knowledge of involved domains and labels. We demonstrate this by integrating it into the nnUNet, which is currently the most popular and accurate framework for medical image segmentation. We employ multiple datasets covering abdominal, cardiac, and lumbar spine scans and compose several out-of-domain scenarios in this study. We demonstrate that our method, combined with pre-trained whole-body CT models, can effectively segment MR images with high accuracy in all of the aforementioned scenarios. Open-source code can be found here:

Gradient-Map-Guided Adaptive Domain Generalization for Cross Modality MRI Segmentation

ADDG: an Adaptive Domain Generalization Framework for Cross-Plane MRI Segmentation

Cross-Modality Brain Tumor Segmentation via Bidirectional Global-to-Local Unsupervised Domain Adaptation

Tri-Directional Tasks Complementary Learning for Unsupervised Domain Adaptation of Cross-modality Medical Image Semantic Segmentation.

CAT-DG: A Cross-Attention-Based Domain Generalization Model for Medical Image Segmentation

MRI Image-to-Image Translation for Cross-Modality Image Registration and Segmentation

MSGAN: Multi-Stage Generative Adversarial Networks for Cross-Modality Domain Adaptation.

DG-TTA: Out-of-domain medical image segmentation through Domain Generalization and Test-Time Adaptation

Generalizable Single-Source Cross-modality Medical Image Segmentation via Invariant Causal Mechanisms

Unsupervised Domain Adaptation With Optimal Transport in Multi-Site Segmentation of Multiple Sclerosis Lesions From MRI Data

[A generative adversarial network-based unsupervised domain adaptation method for magnetic resonance image segmentation]

Mind the Gap: Alleviating Local Imbalance for Unsupervised Cross-Modality Medical Image Segmentation.

Generalizable Cross-modality Medical Image Segmentation Via Style Augmentation and Dual Normalization

GGM-Net: Gradient Constraint on Multi-category Brain MRI Segmentation

Self-Attentive Spatial Adaptive Normalization for Cross-Modality Domain Adaptation

MSCDA: Multi-level Semantic-guided Contrast Improves Unsupervised Domain Adaptation for Breast MRI Segmentation in Small Datasets

Generalizable Cross-modality Medical Image Segmentation via Style Augmentation and Dual Normalization

Unsupervised Cross-Modality Domain Adaptation of ConvNets for Biomedical Image Segmentations with Adversarial Loss

Edge-Guided Output Adaptor: Highly Efficient Adaptation Module for Cross-Vendor Medical Image Segmentation.

Cross-Modality Medical Image Segmentation via Enhanced Feature Alignment and Cross Pseudo Supervision Learning

Domain and Content Adaptive Convolution based Multi-Source Domain Generalization for Medical Image Segmentation