Abstract:Purpose Computer-aided automatic pancreas segmentation is essential for early diagnosis and treatment of pancreatic diseases. However, the annotation of pancreas images requires professional doctors and considerable expenditure. Due to imaging differences among various institution population, scanning devices, imaging protocols, and so on, significant degradation in the performance of model inference results is prone to occur when models trained with domain-specific (usually institution-specific) datasets are directly applied to new (other centers/institutions) domain data. In this paper, we propose a novel unsupervised domain adaptation method based on adversarial learning to address pancreas segmentation challenges with the lack of annotations and domain shift interference. Methods A 3D semantic segmentation model with attention module and residual module is designed as the backbone pancreas segmentation model. In both segmentation model and domain adaptation discriminator network, a multiscale progressively weighted structure is introduced to acquire different field of views. Features of labeled data and unlabeled data are fed in pairs into the proposed multiscale discriminator to learn domain-specific characteristics. Then the unlabeled data features with pseudodomain label are fed to the discriminator to acquire domain-ambiguous information. With this adversarial learning strategy, the performance of the segmentation network is enhanced to segment unseen unlabeled data. Results Experiments were conducted on two public annotated datasets as source datasets, respectively, and one private dataset as target dataset, where annotations were not used for the training process but only for evaluation. The 3D segmentation model achieves comparative performance with state-of-the-art pancreas segmentation methods on source domain. After implementing our domain adaptation architecture, the average dice similarity coefficient (DSC) of the segmentation model trained on the NIH-TCIA source dataset increases from 58.79% to 72.73% on the local hospital dataset, while the performance of the target domain segmentation model transferred from the medical segmentation decathlon (MSD) source dataset rises from 62.34% to 71.17%. Conclusions Correlations of features across data domains are utilized to train the pancreas segmentation model on unlabeled data domain, improving the generalization of the model. Our results demonstrate that the proposed method enables the segmentation model to make meaningful segmentation for unseen data of the training set. In the future, the proposed method has the potential to apply segmentation model trained on public dataset to clinical unannotated CT images from local hospital, effectively assisting radiologists in clinical practice.

Unsupervised Learning for CT Image Segmentation via Adversarial Redrawing

Scribble-Supervised Segmentation of Aerial Building Footprints Using Adversarial Learning

Deep Reinforcement Learning for Weakly-Supervised Lymph Node Segmentation in CT Images

Adaptive Curriculum Learning for Semi-supervised Segmentation of 3D CT-Scans.

Brain Tumor Segmentation Using an Adversarial Network.

Unsupervised domain adaptation based COVID-19 CT infection segmentation network

Unsupervised Network Learning for Cell Segmentation

CADS: A Self-supervised Learner Via Cross-modal Alignment and Deep Self-distillation for CT Volume Segmentation

Annotation-Efficient Learning for Medical Image Segmentation Based on Noisy Pseudo Labels and Adversarial Learning

Weakly Supervised Segmentation of COVID19 Infection with Scribble Annotation on CT Images

Semi-supervised CT image segmentation via contrastive learning based on entropy constraints

Automatic CT Segmentation from Bounding Box Annotations using Convolutional Neural Networks

Self-Supervised Vessel Segmentation Via Adversarial Learning

Multiscale Unsupervised Domain Adaptation for Automatic Pancreas Segmentation in CT Volumes Using Adversarial Learning.

Weakly-supervised Convolutional Neural Networks of Renal Tumor Segmentation in Abdominal CTA Images

Medical image segmentation with generative adversarial semi-supervised network

ASC-Net : Adversarial-based Selective Network for Unsupervised Anomaly Segmentation

Learning to Segment with Image-Level Annotations

Liver Segmentation in CT Images with Adversarial Learning

Multi-scale adversarial learning with difficult region supervision learning models for primary tumor segmentation

Pulmonary Nodule Segmentation with CT Sample Synthesis Using Adversarial Networks