Abstract:Recently, deep neural networks have demonstrated comparable and even better performance than board-certified ophthalmologists in well-annotated datasets. However, the diversity of retinal imaging devices poses a significant challenge: domain shift, which leads to performance degradation when applying the deep learning models trained on one domain to new testing domains. In this paper, we propose a domain adaptation framework comprising of multi-scale inputs along with multiple domain adaptors applied hierarchically in both feature and output spaces. The proposed training strategy and novel unsupervised domain adaptation framework, called Collaborative Adversarial Domain Adaptation (CADA), can effectively overcome the domain shift challenge. Multi-scale inputs can reduce the information loss due to the pooling layers used in the network for feature extraction, while our proposed CADA is an interactive paradigm that presents an exquisite collaborative adaptation through both adversarial learning and ensembling weights at different network layers. In particular, to produce a better prediction for the unlabeled target domain data, we simultaneously achieve domain invariance and model generalizability via adversarial learning at multi-scale outputs from different levels of network layers and maintaining an exponential moving average (EMA) of the historical weights during training. Without annotating any sample from the target domain, multiple adversarial losses in encoder and decoder layers guide the extraction of domain-invariant features to confuse the domain classifier. Meanwhile, the ensembling of weights via EMA reduces the uncertainty of adapting multiple discriminator learning. Comprehensive experimental results demonstrate that our CADA model incorporating multi-scale input training can overcome performance degradation and outperform state-of-the-art domain adaptation methods in segmenting retinal optic disc and cup from fundus images stemming from the REFUGE, Drishti-GS, and Rim-One-r3 datasets. The code is available at https://github.com/cswin/CADA.

Domain adaptation in application to gravitational lens finding

Deep Domain Adversarial Adaptation for Photon-efficient Imaging

Domain-Adaptive Neural Posterior Estimation for Strong Gravitational Lens Analysis

Semi-Supervised Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detection

Optimizing machine learning methods to discover strong gravitational lenses in the Deep Lens Survey

Neural Network Prediction of Strong Lensing Systems with Domain Adaptation and Uncertainty Quantification

DeepAstroUDA: Semi-Supervised Universal Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detection

Discriminative and Geometry-Aware Unsupervised Domain Adaptation

Iterative Landmark Selection and Subspace Alignment for Unsupervised Domain Adaptation

Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives

CADA: Multi-scale Collaborative Adversarial Domain Adaptation for unsupervised optic disc and cup segmentation

Deep unsupervised domain adaptation applied to the Cherenkov Telescope Array Large-Sized Telescope

Revisiting Deep Subspace Alignment for Unsupervised Domain Adaptation

S&GDA: An Unsupervised Domain Adaptive Semantic Segmentation Framework Considering Both Imaging Scene and Geometric Domain Shifts

Self-Guided Adaptation: Progressive Representation Alignment for Domain Adaptive Object Detection

Unsupervised Domain Adaptation: from Simulation Engine to the RealWorld

Can domain adaptation make object recognition work for everyone?

Unsupervised and Semi-Supervised Robust Spherical Space Domain Adaptation.

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Wasserstein Distance Guided Representation Learning for Domain Adaptation

Effective Visual Domain Adaptation via Generative Adversarial Distribution Matching