Abstract:Accurate and robust medical image segmentation is fundamental and crucial for enhancing the autonomy of computer-aided diagnosis and intervention systems. Medical data collection normally involves different scanners, protocols, and populations, making domain adaptation (DA) a highly demanding research field to alleviate model degradation in the deployment site. To preserve the model performance across multiple testing domains, this work proposes the Curriculum-based Augmented Fourier Domain Adaptation (Curri-AFDA) for robust medical image segmentation. In particular, our curriculum learning strategy is based on the causal relationship of a model under different levels of data shift in the deployment phase, where the higher the shift is, the harder to recognize the variance. Considering this, we progressively introduce more amplitude information from the target domain to the source domain in the frequency space during the curriculum-style training to smoothly schedule the semantic knowledge transfer in an easier-to-harder manner. Besides, we incorporate the training-time chained augmentation mixing to help expand the data distributions while preserving the domain-invariant semantics, which is beneficial for the acquired model to be more robust and generalize better to unseen domains. Extensive experiments on two segmentation tasks of Retina and Nuclei collected from multiple sites and scanners suggest that our proposed method yields superior adaptation and generalization performance. Meanwhile, our approach proves to be more robust under various corruption types and increasing severity levels. In addition, we show our method is also beneficial in the domain-adaptive classification task with skin lesion datasets. The code is available at https://github.com/lofrienger/Curri-AFDA. Note to Practitioners—Medical image segmentation is key to improving computer-assisted diagnosis and intervention autonomy. However, due to domain gaps between different medical sites, deep learning-based segmentation models frequently encounter performance degradation when deployed in a novel domain. Moreover, model robustness is also highly expected to mitigate the effects of data corruption. Considering all these demanding yet practical needs to automate medical applications and benefit healthcare, we propose the Curriculum-based Fourier Domain Adaptation (Curri-AFDA) for medical image segmentation. Extensive experiments on two segmentation tasks with cross-domain datasets show the consistent superiority of our method regarding adaptation and generalization on multiple testing domains and robustness against synthetic corrupted data. Besides, our approach is independent of image modalities because its efficacy does not rely on modality-specific characteristics. In addition, we demonstrate the benefit of our method for image classification besides segmentation in the ablation study. Therefore, our method can potentially be applied in many medical applications and yield improved performance. Future works may be extended by exploring the integration of curriculum learning regime with Fourier domain amplitude fusion in the testing time rather than in the training time like this work and most other existing domain adaptation works.

Low-frequency amplitude fusion based consistency learning method for multi-source domain adaptation for joint optic disc and cup segmentation

Retinal Vessel Segmentation Via Cross-attention Feature Fusion

Unsupervised Domain Adaptation Fundus Image Segmentation Via Multi-Scale Adaptive Adversarial Learning.

Adaptive Feature Fusion Neural Network for Glaucoma Segmentation on Unseen Fundus Images

SAMCF: Adaptive global style alignment and multi-color spaces fusion for joint optic cup and disc segmentation

Pseudo-Label Clustering-Driven Dual-Level Contrast Learning Based Source-Free Domain Adaptation for Fundus Image Segmentation.

CFEA: Collaborative Feature Ensembling Adaptation for Domain Adaptation in Unsupervised Optic Disc and Cup Segmentation

TriLA: Triple-Level Alignment Based Unsupervised Domain Adaptation for Joint Segmentation of Optic Disc and Optic Cup

Curriculum-Based Augmented Fourier Domain Adaptation for Robust Medical Image Segmentation

CADA: Multi-scale Collaborative Adversarial Domain Adaptation for unsupervised optic disc and cup segmentation

Adaptive spatial and frequency experts fusion network for medical image fusion

AdaFuse: Adaptive Medical Image Fusion Based on Spatial-Frequential Cross Attention

Domain Specific Convolution and High Frequency Reconstruction Based Unsupervised Domain Adaptation for Medical Image Segmentation

M-MSSEU: Source-Free Domain Adaptation for Multi-Modal Stroke Lesion Segmentation Using Shadowed Sets and Evidential Uncertainty

A geometry-aware multi-coordinate transformation fusion network for optic disc and cup segmentation

Unsupervised Domain Adaptive Fundus Image Segmentation with Few Labeled Source Data

Dual consistent pseudo label generation for multi-source domain adaptation without source data for medical image segmentation

FAMNet: Frequency-aware Matching Network for Cross-domain Few-shot Medical Image Segmentation

ECSD-Net: A Joint Optic Disc and Cup Segmentation and Glaucoma Classification Network Based on Unsupervised Domain Adaptation

Self-ensembling with mask-boundary domain adaptation for optic disc and cup segmentation