Abstract:Data augmentation is widely applied to medical image analysis tasks in limited datasets with imbalanced classes and insufficient annotations. However, traditional augmentation techniques cannot supply extra information, making the performance of diagnosis unsatisfactory. GAN-based generative methods have thus been proposed to obtain additional useful information to realize more effective data augmentation; but existing generative data augmentation techniques mainly encounter two problems: (i) Current generative data augmentation lacks of the capability in using cross-domain differential information to extend limited datasets. (ii) The existing generative methods cannot provide effective supervised information in medical image segmentation tasks. To solve these problems, we propose an attention-guided cross-domain tumor image generation model (CDA-GAN) with an information enhancement strategy. The CDA-GAN can generate diverse samples to expand the scale of datasets, improving the performance of medical image diagnosis and treatment tasks. In particular, we incorporate channel attention into a CycleGAN-based cross-domain generation network that captures inter-domain information and generates positive or negative samples of brain tumors. In addition, we propose a semi-supervised spatial attention strategy to guide spatial information of features at the pixel level in tumor generation. Furthermore, we add spectral normalization to prevent the discriminator from mode collapse and stabilize the training procedure. Finally, to resolve an inapplicability problem in the segmentation task, we further propose an application strategy of using this data augmentation model to achieve more accurate medical image segmentation with limited data. Experimental studies on two public brain tumor datasets (BraTS and TCIA) show that the proposed CDA-GAN model greatly outperforms the state-of-the-art generative data augmentation in both practical medical image classification tasks and segmentation tasks; e.g. CDA-GAN is 0.50%, 1.72%, 2.05%, and 0.21% better than the best SOTA baseline in terms of ACC, AUC, Recall, and F1, respectively, in the classification task of BraTS, while its improvements w.r.t. the best SOTA baseline in terms of Dice, Sens, HD95, and mIOU, in the segmentation task of TCIA are 2.50%, 0.90%, 14.96%, and 4.18%, respectively.

A New Multiple-Distribution GAN Model to Solve Complexity in End-to-End Chromosome Karyotyping

End-To-End Chromosome Karyotyping with Data Augmentation Using GAN

Enhanced Rotated Mask R-CNN for Chromosome Segmentation.

A novel end-to-end chromosome classification approach using deep neural network with triple attention mechanism

Chromosome classification via deep learning and its application to patients with structural abnormalities of chromosomes

Deep Anomaly Generation: An Image Translation Approach of Synthesizing Abnormal Banded Chromosome Images

Adversarial Multiscale Feature Learning Framework for Overlapping Chromosome Segmentation

Cross-domain attention-guided generative data augmentation for medical image analysis with limited data

MedGAN: An adaptive GAN approach for medical image generation

Generative Adversarial Networks in Medical Image Processing

SAG-GAN: Semi-Supervised Attention-Guided GANs for Data Augmentation on Medical Images

An automatic progressive chromosome segmentation approach using deep learning with traditional image processing

GAN-based one dimensional medical data augmentation

Enhanced label constrained contrastive learning for chromosome optical microscopic image classification

Voxel-wise Medical Images Generalization for Eliminating Distribution Shift

Improving Skin Cancer Classification Using Heavy-Tailed Student T-Distribution in Generative Adversarial Networks (TED-GAN)

MD-GAN: Multi-Discriminator Generative Adversarial Networks for Distributed Datasets

Hierarchical Amortized GAN for 3D High Resolution Medical Image Synthesis

An improved multi-scale gradient generative adversarial network for enhancing classification of colorectal cancer histological images

BR-ChromNet: Banding Resolution Localization of Chromosome Structural Abnormality with Conditional Random Field

A Novel Conditional Medical Image Generation GAN with Latent Space Optimal Transport