Abstract:Background and objective Unsupervised domain adaptation (UDA) is a powerful approach in tackling domain discrepancies and reducing the burden of laborious and error-prone pixel-level annotations for instance segmentation. However, the domain adaptation strategies utilized in previous instance segmentation models pool all the labeled/detected instances together to train the instance-level GAN discriminator, which neglects the differences among multiple instance categories. Such pooling prevents UDA instance segmentation models from learning categorical correspondence between source and target domains for accurate instance classification; Methods To tackle this challenge, we propose an Instance Segmentation CycleGAN (ISC-GAN) algorithm for UDA multiclass-instance segmentation. We conduct extensive experiments on the multiclass nuclei recognition task to transfer knowledge from hematoxylin and eosin to immunohistochemistry stained pathology images. Specifically, we fuse CycleGAN with Mask R-CNN to learn categorical correspondence with image-level domain adaptation and virtual supervision. Moreover, we utilize Curriculum Learning to separate the learning process into two steps: (1) learning segmentation only on labeled source data, and (2) learning target domain segmentation with paired virtual labels generated by ISC-GAN. The performance was further improved through experiments with other strategies, including Shared Weights, Knowledge Distillation, and Expanded Source Data. Results Comparing to the baseline model or the three UDA instance detection and segmentation models, ISC-GAN illustrates the state-of-the-art performance, with 39.1% average precision and 48.7% average recall. The source codes of ISC-GAN are available at https://github.com/sdw95927/InstanceSegmentation-CycleGAN . Conclusion ISC-GAN adapted knowledge from hematoxylin and eosin to immunohistochemistry stained pathology images, suggesting the potential for reducing the need for large annotated pathological image datasets in deep learning and computer vision tasks.

Unsupervised Domain Adaptation for Mammogram Image Classification: A Promising Tool for Model Generalization

Domain Invariant Model with Graph Convolutional Network for Mammogram Classification

Unsupervised Domain Adaptation with Adversarial Learning for Liver Tumors Detection in Multi-phase CT Images

A Survey on Domain Generalization for Medical Image Analysis

Domain Generalization for Mammographic Image Analysis with Contrastive Learning

Unsupervised Domain Adaptation Using Feature Disentanglement And GCNs For Medical Image Classification

Collaborative Unsupervised Domain Adaptation for Medical Image Diagnosis

Generative adversarial U-Net for domain-free few-shot medical diagnosis

Unsupervised domain adaptation for the detection of cardiomegaly in cross-domain chest X-ray images

Data Augmentation-Based Unsupervised Domain Adaptation In Medical Imaging

SEMI-SUPERVISED DOMAIN GENERALIZATION FOR MEDICAL IMAGE ANALYSIS

U-shaped GAN for Semi-Supervised Learning and Unsupervised Domain Adaptation in High Resolution Chest Radiograph Segmentation

Domain Adaptation for Medical Image Classification Without Source Data

SAG-GAN: Semi-Supervised Attention-Guided GANs for Data Augmentation on Medical Images

General Multiscenario Ultrasound Image Tumor Diagnosis Method Based on Unsupervised Domain Adaptation

Unsupervised domain adaptation for nuclei segmentation: Adapting from hematoxylin & eosin stained slides to immunohistochemistry stained slides using a curriculum approach

MammoDG: Generalisable Deep Learning Breaks the Limits of Cross-Domain Multi-Center Breast Cancer Screening

Exposing Unseen GAN-generated Image Using Unsupervised Domain Adaptation

Utilizing GCN and Meta-Learning Strategy in Unsupervised Domain Adaptation for Pancreatic Cancer Segmentation

Domain generalization in deep learning based mass detection in mammography: A large-scale multi-center study

Generative Adversarial U-Net for Domain-free Medical Image Augmentation