Synthesizing PET Scans Using Attention GAN Based on MRI Scans and Alzheimer's Disease Information.

Qing Guo,Jianjun Zhang,Peishun Liu,Xianchang Liu,Qinshuo Wang,Ruichun Tang
DOI: https://doi.org/10.1145/3604078.3604162
2023-01-01
Abstract:Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) can facilitate the diagnosis of Alzheimer's disease (AD). But PET data are not always available due to high financial costs and some other reasons. A common research approach to this problem is to filter out incomplete data, which will reduce the sample size. In order to solve the problem of missing PET data, we propose a new attention GAN model AMIGAN, which learns an end-to-end mapping function to generate PET scans from MRI and disease clinical information. We design a 3D attention multi-scale convolutional U-Net generator architecture and implement a pyramidal convolutional attention module PCAM for the generator skip connection process. PCAM can focus on image detail and improve the visual quality of the synthesized PET scans. Moreover, two discriminators are built for image authenticity discrimination and disease information category discrimination respectively, and disease information is integrated into the generated image. In addition, the standard adversarial loss is supplemented with structural similarity loss, reconstruction loss and disease information category loss components, which reduce the reconstruction error and enhance structural consistency across different angles. Experiments show that AMIGAN has better image generation performance than previously proposed methods.
What problem does this paper attempt to address?