Abstract:Recently, deep neural networks have demonstrated comparable and even better performance than board-certified ophthalmologists in well-annotated datasets. However, the diversity of retinal imaging devices poses a significant challenge: domain shift, which leads to performance degradation when applying the deep learning models trained on one domain to new testing domains. In this paper, we propose a domain adaptation framework comprising of multi-scale inputs along with multiple domain adaptors applied hierarchically in both feature and output spaces. The proposed training strategy and novel unsupervised domain adaptation framework, called Collaborative Adversarial Domain Adaptation (CADA), can effectively overcome the domain shift challenge. Multi-scale inputs can reduce the information loss due to the pooling layers used in the network for feature extraction, while our proposed CADA is an interactive paradigm that presents an exquisite collaborative adaptation through both adversarial learning and ensembling weights at different network layers. In particular, to produce a better prediction for the unlabeled target domain data, we simultaneously achieve domain invariance and model generalizability via adversarial learning at multi-scale outputs from different levels of network layers and maintaining an exponential moving average (EMA) of the historical weights during training. Without annotating any sample from the target domain, multiple adversarial losses in encoder and decoder layers guide the extraction of domain-invariant features to confuse the domain classifier. Meanwhile, the ensembling of weights via EMA reduces the uncertainty of adapting multiple discriminator learning. Comprehensive experimental results demonstrate that our CADA model incorporating multi-scale input training can overcome performance degradation and outperform state-of-the-art domain adaptation methods in segmenting retinal optic disc and cup from fundus images stemming from the REFUGE, Drishti-GS, and Rim-One-r3 datasets. The code is available at https://github.com/cswin/CADA.

Few-shot Adaptive Faster R-CNN — Supplementary Material

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Few-shot Adaptive Faster R-CNN

Source data-free domain adaptation for a faster R-CNN

Acceleration of multi-task cascaded convolutional networks

DAGL-Faster: Domain adaptive faster r-cnn for vehicle object detection in rainy and foggy weather conditions

SAM-Adapter: Adapting Segment Anything in Underperformed Scenes

Crowd counting via unsupervised cross-domain feature adaptation

Benchmarking Test-Time Adaptation against Distribution Shifts in Image Classification

Adversarial Robustness under Long-Tailed Distribution Supplementary Material

DomainAdaptor: A Novel Approach to Test-time Adaptation

CADA: Multi-scale Collaborative Adversarial Domain Adaptation for unsupervised optic disc and cup segmentation

FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptation.

AdaNPC: Exploring Non-Parametric Classifier for Test-Time Adaptation

Enhancing Test Time Adaptation with Few-shot Guidance

Domain adaptation of object detector using scissor-like networks

Scale Aware Adaptation for Land-Cover Classification in Remote Sensing Imagery

Scale-Aware Domain Adaptive Faster R-CNN

Domain Adaptive Object Detection via Asymmetric Tri-way Faster-RCNN

BiLSTM-TANet: an adaptive diverse scenes model with context embeddings for few-shot learning

Adaptive FSS: A Novel Few-Shot Segmentation Framework Via Prototype Enhancement