RADIOGAN: Deep Convolutional Conditional Generative adversarial Network To Generate PET Images

Amine Amyar,Su Ruan,Pierre Vera,Pierre Decazes,Romain Modzelewski
DOI: https://doi.org/10.48550/arXiv.2003.08663
2020-03-19
Abstract:One of the most challenges in medical imaging is the lack of data. It is proven that classical data augmentation methods are useful but still limited due to the huge variation in images. Using generative adversarial networks (GAN) is a promising way to address this problem, however, it is challenging to train one model to generate different classes of lesions. In this paper, we propose a deep convolutional conditional generative adversarial network to generate MIP positron emission tomography image (PET) which is a 2D image that represents a 3D volume for fast interpretation, according to different lesions or non lesion (normal). The advantage of our proposed method consists of one model that is capable of generating different classes of lesions trained on a small sample size for each class of lesion, and showing a very promising results. In addition, we show that a walk through a latent space can be used as a tool to evaluate the images generated.
Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the problem of insufficient data in the field of medical imaging, especially in the generation of positron emission tomography (PET) images. Specifically, the paper focuses on how to use the Deep Convolutional Conditional Generative Adversarial Network (DCCGAN) to generate PET images of Maximum Intensity Projection (MIP). These images are 2D representations of 3D volumes and are used for the rapid interpretation of different types of lesions or normal conditions. The method proposed in the paper aims to overcome the limitations of existing methods in dealing with different types of lesions, that is, it is able to train a model to generate images of multiple types of lesions with a small sample size and shows very promising results. In addition, the paper also explores the method of evaluating the quality of generated images through latent space walking to distinguish whether the model generates completely new images or just memorizes the images in the training set.