Abstract:Combining multi-modality data for brain disease diagnosis such as Alzheimer’s disease (AD) commonly leads to improved performance than those using a single modality. However, it is still challenging to train a multi-modality model since it is difficult in clinical practice to obtain complete data that includes all modality data. Generally speaking, it is difficult to obtain both magnetic resonance images (MRI) and positron emission tomography (PET) images of a single patient. PET is expensive and requires the injection of radioactive substances into the patient’s body, while MR images are cheaper, safer, and more widely used in practice. Discarding samples without PET data is a common method in previous studies, but the reduction in the number of samples will result in a decrease in model performance. To take advantage of multi-modal complementary information, we first adopt the Reversible Generative Adversarial Network (RevGAN) model to reconstruct the missing data. After that, a 3D convolutional neural network (CNN) classification model with multi-modality input was proposed to perform AD diagnosis. We have evaluated our method on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database, and compared the performance of the proposed method with those using state-of-the-art methods. The experimental results show that the structural and functional information of brain tissue can be mapped well and that the image synthesized by our method is close to the real image. In addition, the use of synthetic data is beneficial for the diagnosis and prediction of Alzheimer’s disease, demonstrating the effectiveness of the proposed framework.

Brain MR to PET Synthesis via Bidirectional Generative Adversarial Network

Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesis

A Novel Method Of Synthetic Ct Generation From Mr Images Based On Convolutional Neural Networks

A Resource-Efficient Deep Learning Framework for Low-Dose Brain PET Image Reconstruction and Analysis

GANBERT: Generative Adversarial Networks with Bidirectional Encoder Representations from Transformers for MRI to PET synthesis

Synthesis of Positron Emission Tomography (PET) Images via Multi-channel Generative Adversarial Networks (GANs)

Vitamins and immunity: II. Influence of L-carnitine on the immune system.

MRI to PET Cross-Modality Translation using Globally and Locally Aware GAN (GLA-GAN) for Multi-Modal Diagnosis of Alzheimer's Disease

Bidirectional Mapping of Brain MRI and PET With 3D Reversible GAN for the Diagnosis of Alzheimer’s Disease

Cross-Modality Generation of Amyloid PET from FDG PET for Alzheimer’s Disease Diagnosis

Multimodal MR Image Synthesis Using Gradient Prior and Adversarial Learning

Multi-Constraint Transferable Generative Adversarial Networks for Cross-Modal Brain Image Synthesis

Generative Adversarial Networks for Brain Images Synthesis: A Review

Synthetic Brain Images: Bridging the Gap in Brain Mapping With Generative Adversarial Model

Multiscale Deep-Learning Network Based Reconstruction of PET Images from Sinogram Domain

FedMed-GAN: Federated Domain Translation on Unsupervised Cross-Modality Brain Image Synthesis

Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

A two-dimensional ZnII coordination polymer constructed from benzene-1,2,3-tricarboxylic acid and N,N'-bis[(pyridin-4-yl)methylidene]hydrazine.

MMFGAN: A novel multimodal brain medical image fusion based on the improvement of generative adversarial network

FDG-PET to T1 Weighted MRI Translation with 3D Elicit Generative Adversarial Network (E-GAN)

3D Segmentation Guided Style-based Generative Adversarial Networks for PET Synthesis