Abstract:Recently, deep neural networks have demonstrated comparable and even better performance than board-certified ophthalmologists in well-annotated datasets. However, the diversity of retinal imaging devices poses a significant challenge: domain shift, which leads to performance degradation when applying the deep learning models trained on one domain to new testing domains. In this paper, we propose a domain adaptation framework comprising of multi-scale inputs along with multiple domain adaptors applied hierarchically in both feature and output spaces. The proposed training strategy and novel unsupervised domain adaptation framework, called Collaborative Adversarial Domain Adaptation (CADA), can effectively overcome the domain shift challenge. Multi-scale inputs can reduce the information loss due to the pooling layers used in the network for feature extraction, while our proposed CADA is an interactive paradigm that presents an exquisite collaborative adaptation through both adversarial learning and ensembling weights at different network layers. In particular, to produce a better prediction for the unlabeled target domain data, we simultaneously achieve domain invariance and model generalizability via adversarial learning at multi-scale outputs from different levels of network layers and maintaining an exponential moving average (EMA) of the historical weights during training. Without annotating any sample from the target domain, multiple adversarial losses in encoder and decoder layers guide the extraction of domain-invariant features to confuse the domain classifier. Meanwhile, the ensembling of weights via EMA reduces the uncertainty of adapting multiple discriminator learning. Comprehensive experimental results demonstrate that our CADA model incorporating multi-scale input training can overcome performance degradation and outperform state-of-the-art domain adaptation methods in segmenting retinal optic disc and cup from fundus images stemming from the REFUGE, Drishti-GS, and Rim-One-r3 datasets. The code is available at https://github.com/cswin/CADA.

Generative appearance replay for continual unsupervised domain adaptation

Multi-scale Feature Alignment for Continual Learning of Unlabeled Domains

A New Bidirectional Unsupervised Domain Adaptation Segmentation Framework

Domain Adaptive Diabetic Retinopathy Grading with Model Absence and Flowing Data

Unsupervised Domain Adaptation in Activity Recognition: A GAN-Based Approach

Gradual Domain Adaptation: Theory and Algorithms

FRIDA -- Generative Feature Replay for Incremental Domain Adaptation

Continuous Unsupervised Domain Adaptation Using Stabilized Representations and Experience Replay

Comprehensive Generative Replay for Task-Incremental Segmentation with Concurrent Appearance and Semantic Forgetting

One-shot Generative Domain Adaptation in 3D GANs

Decomposition-based Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation

Complementary Domain Adaptation and Generalization for Unsupervised Continual Domain Shift Learning

GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generators

CADA: Multi-scale Collaborative Adversarial Domain Adaptation for unsupervised optic disc and cup segmentation

GrabDAE: An Innovative Framework for Unsupervised Domain Adaptation Utilizing Grab-Mask and Denoise Auto-Encoder

Domain Adaptive and Generalizable Network Architectures and Training Strategies for Semantic Image Segmentation

Deep Cycle Autoencoder for Unsupervised Domain Adaptation with Generative Adversarial Networks

AADG: Automatic Augmentation for Domain Generalization on Retinal Image Segmentation.

Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives

Learning Part Segmentation Through Unsupervised Domain Adaptation from Synthetic Vehicles