Abstract:Deep learning has achieved considerable success in medical image segmentation. However, applying deep learning in clinical environments often involves two problems: (1) scarcity of annotated data as data annotation is time-consuming and (2) varying attributes of different datasets due to domain shift. To address these problems, we propose an improved generative adversarial network (GAN) segmentation model, called U-shaped GAN, for limited-annotated chest radiograph datasets. The semi-supervised learning approach and unsupervised domain adaptation (UDA) approach are modeled into a unified framework for effective segmentation. We improve GAN by replacing the traditional discriminator with a U-shaped net, which predicts each pixel a label. The proposed U-shaped net is designed with high resolution radiographs (1,024 × 1,024) for effective segmentation while taking computational burden into account. The pointwise convolution is applied to U-shaped GAN for dimensionality reduction, which decreases the number of feature maps while retaining their salient features. Moreover, we design the U-shaped net with a pretrained ResNet-50 as an encoder to reduce the computational burden of training the encoder from scratch. A semi-supervised learning approach is proposed learning from limited annotated data while exploiting additional unannotated data with a pixel-level loss. U-shaped GAN is extended to UDA by taking the source and target domain data as the annotated data and the unannotated data in the semi-supervised learning approach, respectively. Compared to the previous models dealing with the aforementioned problems separately, U-shaped GAN is compatible with varying data distributions of multiple medical centers, with efficient training and optimizing performance. U-shaped GAN can be generalized to chest radiograph segmentation for clinical deployment. We evaluate U-shaped GAN with two chest radiograph datasets. U-shaped GAN is shown to significantly outperform the state-of-the-art models.

Semi-supervised Multi-task Learning with Chest X-Ray Images

Multi-task Attention-Based Semi-supervised Learning for Medical Image Segmentation

Partly Supervised Multitask Learning

An Efficient Semi-Supervised Framework with Multi-Task and Curriculum Learning for Medical Image Segmentation

Multi-task Semi-supervised Learning for Pulmonary Lobe Segmentation

Multi-task Learning for Chest X-ray Abnormality Classification on Noisy Labels

Multi-task contrastive learning for semi-supervised medical image segmentation with multi-scale uncertainty estimation

Two-Stage Multi-task Self-Supervised Learning for Medical Image Segmentation

Self-supervised multi-task learning for medical image analysis

[Non-local attention and multi-task learning based lung segmentation in chest X-ray]

Dual-Task Mutual Learning for Semi-Supervised Medical Image Segmentation

Weakly-Supervised Segmentation for Disease Localization in Chest X-Ray Images

U-shaped GAN for Semi-Supervised Learning and Unsupervised Domain Adaptation in High Resolution Chest Radiograph Segmentation

A Multi-Task Cross-Task Learning Architecture for Ad-hoc Uncertainty Estimation in 3D Cardiac MRI Image Segmentation

Fully Convolutional Architectures for Multi-Class Segmentation in Chest Radiographs

Generalizable multi-task, multi-domain deep segmentation of sparse pediatric imaging datasets via multi-scale contrastive regularization and multi-joint anatomical priors

Robust Semi-supervised 3D Medical Image Segmentation with Diverse Joint-task Learning and Decoupled Inter-student Learning

Automatic Segmentation of Pneumothorax in Chest Radiographs Based on Dual-Task Interactive Learning Method

Multi-task Learning To Improve Semantic Segmentation Of CBCT Scans Using Image Reconstruction

Multitask Learning for Concurrent Grading Diagnosis and Semi-Supervised Segmentation of Honeycomb Lung in CT Images

Multi-task learning for classification, segmentation, reconstruction, and detection on chest CT scans