Abstract:Data augmentation is widely applied to medical image analysis tasks in limited datasets with imbalanced classes and insufficient annotations. However, traditional augmentation techniques cannot supply extra information, making the performance of diagnosis unsatisfactory. GAN-based generative methods have thus been proposed to obtain additional useful information to realize more effective data augmentation; but existing generative data augmentation techniques mainly encounter two problems: (i) Current generative data augmentation lacks of the capability in using cross-domain differential information to extend limited datasets. (ii) The existing generative methods cannot provide effective supervised information in medical image segmentation tasks. To solve these problems, we propose an attention-guided cross-domain tumor image generation model (CDA-GAN) with an information enhancement strategy. The CDA-GAN can generate diverse samples to expand the scale of datasets, improving the performance of medical image diagnosis and treatment tasks. In particular, we incorporate channel attention into a CycleGAN-based cross-domain generation network that captures inter-domain information and generates positive or negative samples of brain tumors. In addition, we propose a semi-supervised spatial attention strategy to guide spatial information of features at the pixel level in tumor generation. Furthermore, we add spectral normalization to prevent the discriminator from mode collapse and stabilize the training procedure. Finally, to resolve an inapplicability problem in the segmentation task, we further propose an application strategy of using this data augmentation model to achieve more accurate medical image segmentation with limited data. Experimental studies on two public brain tumor datasets (BraTS and TCIA) show that the proposed CDA-GAN model greatly outperforms the state-of-the-art generative data augmentation in both practical medical image classification tasks and segmentation tasks; e.g. CDA-GAN is 0.50%, 1.72%, 2.05%, and 0.21% better than the best SOTA baseline in terms of ACC, AUC, Recall, and F1, respectively, in the classification task of BraTS, while its improvements w.r.t. the best SOTA baseline in terms of Dice, Sens, HD95, and mIOU, in the segmentation task of TCIA are 2.50%, 0.90%, 14.96%, and 4.18%, respectively.

MASG-GAN: A multi-view attention superpixel-guided generative adversarial network for efficient and simultaneous histopathology image segmentation and classification

Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images

A Generative Adversarial Network Fused with Dual-Attention Mechanism and Its Application in Multitarget Image Fine Segmentation

An improved multi-scale gradient generative adversarial network for enhancing classification of colorectal cancer histological images

Multi-scale self-attention generative adversarial network for pathology image restoration

Automatic multi-tissue segmentation in pancreatic pathological images with selected multi-scale attention network

Selective Synthetic Augmentation with HistoGAN for Improved Histopathology Image Classification

Unified Framework for Histopathology Image Augmentation and Classification via Generative Models

Pathological Image Super-Resolution Using Mix-Attention Generative Adversarial Network

Segmentation of skin lesion using superpixel guided generative adversarial network with dual-stream patch-based discriminators

AWGUNET: Attention-Aided Wavelet Guided U-Net for Nuclei Segmentation in Histopathology Images

Multi-Scale Attention Generative Adversarial Network for Medical Image Enhancement

ELMGAN: A GAN-based efficient lightweight multi-scale-feature-fusion multi-task model

Multifunctional aggregation network of cell nuclei segmentation aiming histopathological diagnosis assistance: A new MA-Net construction

Hi- g MISnet: generalized medical image segmentation using DWT based multilayer fusion and dual mode attention into high resolution p GAN

A Multi-scale Graph Network with Multi-head Attention for Histopathology Image Diagnosisn

SAP‐cGAN: Adversarial learning for breast mass segmentation in digital mammogram based on superpixel average pooling

SegAN: Adversarial Network with Multi-scale $L_1$ Loss for Medical Image Segmentation

AM-AN: Adversarial Network Based on Attention Mechanism for Medical Image Segmentation

Cross-domain attention-guided generative data augmentation for medical image analysis with limited data