Abstract:Medical image data is critically important for a range of disciplines, including medical image perception research, clinician training programs, and computer vision algorithms, among many other applications. Authentic medical image data, unfortunately, is relatively scarce for many of these uses. Because of this, researchers often collect their own data in nearby hospitals, which limits the generalizabilty of the data and findings. Moreover, even when larger datasets become available, they are of limited use because of the necessary data processing procedures such as de-identification, labeling, and categorizing, which requires significant time and effort. Thus, in some applications, including behavioral experiments on medical image perception, researchers have used naive artificial medical images (e.g., shapes or textures that are not realistic). These artificial medical images are easy to generate and manipulate, but the lack of authenticity inevitably raises questions about the applicability of the research to clinical practice. Recently, with the great progress in Generative Adversarial Networks (GAN), authentic images can be generated with high quality. In this paper, we propose to use GAN to generate authentic medical images for medical imaging studies. We also adopt a controllable method to manipulate the generated image attributes such that these images can satisfy any arbitrary experimenter goals, tasks, or stimulus settings. We have tested the proposed method on various medical image modalities, including mammogram, MRI, CT, and skin cancer images. The generated authentic medical images verify the success of the proposed method. The model and generated images could be employed in any medical image perception research.

3D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Images

Latent space manipulation for high-resolution medical image synthesis via the StyleGAN

Conditional GAN with an Attention-Based Generator and a 3D Discriminator for 3D Medical Image Generation

Evaluating the Performance of StyleGAN2-ADA on Medical Images

Hierarchical Amortized GAN for 3D High Resolution Medical Image Synthesis

Inflating 2D Convolution Weights for Efficient Generation of 3D Medical Images

High-resolution medical image synthesis using progressively grown generative adversarial networks

Three-dimensional Bone Image Synthesis with Generative Adversarial Networks

Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networks

GANs for Medical Image Synthesis: An Empirical Study

MedGAN: An adaptive GAN approach for medical image generation

Controllable Medical Image Generation via GAN

Deep Generative Models for 3D Medical Image Synthesis

MinimalGAN: diverse medical image synthesis for data augmentation using minimal training data

Brain tumor image generation using an aggregation of GAN models with style transfer

Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Data

Multi-Constraint Transferable Generative Adversarial Networks for Cross-Modal Brain Image Synthesis

Brain Tumor Synthetic Data Generation with Adaptive StyleGANs

MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation

Generative Adversarial Networks in Medical Image Processing

Generative Enhancement for 3D Medical Images