Abstract:Data augmentation is widely applied to medical image analysis tasks in limited datasets with imbalanced classes and insufficient annotations. However, traditional augmentation techniques cannot supply extra information, making the performance of diagnosis unsatisfactory. GAN-based generative methods have thus been proposed to obtain additional useful information to realize more effective data augmentation; but existing generative data augmentation techniques mainly encounter two problems: (i) Current generative data augmentation lacks of the capability in using cross-domain differential information to extend limited datasets. (ii) The existing generative methods cannot provide effective supervised information in medical image segmentation tasks. To solve these problems, we propose an attention-guided cross-domain tumor image generation model (CDA-GAN) with an information enhancement strategy. The CDA-GAN can generate diverse samples to expand the scale of datasets, improving the performance of medical image diagnosis and treatment tasks. In particular, we incorporate channel attention into a CycleGAN-based cross-domain generation network that captures inter-domain information and generates positive or negative samples of brain tumors. In addition, we propose a semi-supervised spatial attention strategy to guide spatial information of features at the pixel level in tumor generation. Furthermore, we add spectral normalization to prevent the discriminator from mode collapse and stabilize the training procedure. Finally, to resolve an inapplicability problem in the segmentation task, we further propose an application strategy of using this data augmentation model to achieve more accurate medical image segmentation with limited data. Experimental studies on two public brain tumor datasets (BraTS and TCIA) show that the proposed CDA-GAN model greatly outperforms the state-of-the-art generative data augmentation in both practical medical image classification tasks and segmentation tasks; e.g. CDA-GAN is 0.50%, 1.72%, 2.05%, and 0.21% better than the best SOTA baseline in terms of ACC, AUC, Recall, and F1, respectively, in the classification task of BraTS, while its improvements w.r.t. the best SOTA baseline in terms of Dice, Sens, HD95, and mIOU, in the segmentation task of TCIA are 2.50%, 0.90%, 14.96%, and 4.18%, respectively.

Learning with limited target data to detect cells in cross-modality images

Low-Resource Adversarial Domain Adaptation for Cross-Modality Nucleus Detection

Unsupervised domain adaptation for nuclei segmentation: Adapting from hematoxylin & eosin stained slides to immunohistochemistry stained slides using a curriculum approach

Cross-domain attention-guided generative data augmentation for medical image analysis with limited data

GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks

Diverse Data Augmentation for Learning Image Segmentation with Cross-Modality Annotations.

Bidirectional cross-modality unsupervised domain adaptation using generative adversarial networks for cardiac image segmentation

ELMGAN: A GAN-based efficient lightweight multi-scale-feature-fusion multi-task model

Learning More with Less: GAN-based Medical Image Augmentation

Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images

A U-Net Based Progressive GAN for Microscopic Image Augmentation

U-shaped GAN for Semi-Supervised Learning and Unsupervised Domain Adaptation in High Resolution Chest Radiograph Segmentation

ISGAN: Unsupervised Domain Adaptation with Improved Symmetric GAN for Cross-Modality Multi-organ Segmentation

Unsupervised Domain Adaptation for the Histopathological Cell Segmentation Through Self-Ensembling

GSDA: Generative Adversarial Network-based Semi-Supervised Data Augmentation for Ultrasound Image Classification

Learning to Generalize over Subpartitions for Heterogeneity-aware Domain Adaptive Nuclei Segmentation

Combining Noise-to-Image and Image-to-Image GANs: Brain MR Image Augmentation for Tumor Detection

Evaluating generative adversarial networks based image-level domain transfer for multi-source remote sensing image segmentation and object detection

SAG-GAN: Semi-Supervised Attention-Guided GANs for Data Augmentation on Medical Images

Applying Conditional Generative Adversarial Networks for Imaging Diagnosis