Abstract:Deep learning has achieved considerable success in medical image segmentation. However, applying deep learning in clinical environments often involves two problems: (1) scarcity of annotated data as data annotation is time-consuming and (2) varying attributes of different datasets due to domain shift. To address these problems, we propose an improved generative adversarial network (GAN) segmentation model, called U-shaped GAN, for limited-annotated chest radiograph datasets. The semi-supervised learning approach and unsupervised domain adaptation (UDA) approach are modeled into a unified framework for effective segmentation. We improve GAN by replacing the traditional discriminator with a U-shaped net, which predicts each pixel a label. The proposed U-shaped net is designed with high resolution radiographs (1,024 × 1,024) for effective segmentation while taking computational burden into account. The pointwise convolution is applied to U-shaped GAN for dimensionality reduction, which decreases the number of feature maps while retaining their salient features. Moreover, we design the U-shaped net with a pretrained ResNet-50 as an encoder to reduce the computational burden of training the encoder from scratch. A semi-supervised learning approach is proposed learning from limited annotated data while exploiting additional unannotated data with a pixel-level loss. U-shaped GAN is extended to UDA by taking the source and target domain data as the annotated data and the unannotated data in the semi-supervised learning approach, respectively. Compared to the previous models dealing with the aforementioned problems separately, U-shaped GAN is compatible with varying data distributions of multiple medical centers, with efficient training and optimizing performance. U-shaped GAN can be generalized to chest radiograph segmentation for clinical deployment. We evaluate U-shaped GAN with two chest radiograph datasets. U-shaped GAN is shown to significantly outperform the state-of-the-art models.

UGAN: Semi-supervised Medical Image Segmentation Using Generative Adversarial Network

Generative Adversarial Semi-Supervised Network for Medical Image Segmentation

Medical image segmentation with generative adversarial semi-supervised network

GU-Net: Causal relationship-based generative medical image segmentation model

U-shaped GAN for Semi-Supervised Learning and Unsupervised Domain Adaptation in High Resolution Chest Radiograph Segmentation

EnGAN: Enhancement Generative Adversarial Network in Medical Image Segmentation

Automatic Segmentation of Prostate Magnetic Resonance Imaging Using Generative Adversarial Networks

SegAN: Adversarial Network with Multi-scale $L_1$ Loss for Medical Image Segmentation

The Domain Shift Problem of Medical Image Segmentation and Vendor-Adaptation by Unet-GAN

Generative Adversarial Networks for Pre-training of Medical Image Segmentation Networks

UENet: A Novel Generative Adversarial Network for Angiography Image Segmentation.

ISGAN: Unsupervised Domain Adaptation with Improved Symmetric GAN for Cross-Modality Multi-organ Segmentation

Segmentation using adversarial image-to-image networks

Generative Adversarial U-Net for Domain-free Medical Image Augmentation

Isdnet: Importance Guided Semi-Supervised Adversarial Learning For Medical Image Segmentation

URO-GAN: an Untrustworthy Region Optimization Approach for Adipose Tissue Segmentation Based on Adversarial Learning

AM-AN: Adversarial Network Based on Attention Mechanism for Medical Image Segmentation

A Medical Image Segmentation Algorithm Based on Spatial and Channel Attention Mechanisms and Data Augmentation

Object-Level Remote Sensing Image Augmentation Using U-Net-Based Generative Adversarial Networks

Lesion Segmentation in Gastroscopic Images Using Generative Adversarial Networks.