Abstract:Generative approaches for cross-modality transformation have recently gained significant attention in neuroimaging. While most previous work has focused on case-control data, the application of generative models to disorder-specific datasets and their ability to preserve diagnostic patterns remain relatively unexplored. Hence, in this study, we investigated the use of a generative adversarial network (GAN) in the context of Alzheimer's disease (AD) to generate functional network connectivity (FNC) and T1-weighted structural magnetic resonance imaging data from each other. We employed a cycle-GAN to synthesize data in an unpaired data transition and enhanced the transition by integrating weak supervision in cases where paired data were available. Our findings revealed that our model could offer remarkable capability, achieving a structural similarity index measure (SSIM) of $0.89 \pm 0.003$ for T1s and a correlation of $0.71 \pm 0.004$ for FNCs. Moreover, our qualitative analysis revealed similar patterns between generated and actual data when comparing AD to cognitively normal (CN) individuals. In particular, we observed significantly increased functional connectivity in cerebellar-sensory motor and cerebellar-visual networks and reduced connectivity in cerebellar-subcortical, auditory-sensory motor, sensory motor-visual, and cerebellar-cognitive control networks. Additionally, the T1 images generated by our model showed a similar pattern of atrophy in the hippocampal and other temporal regions of Alzheimer's patients.

What problem does this paper attempt to address?

This paper aims to solve the problem of modality missing in the multi - modal datasets of Alzheimer's Disease (AD), especially the ability to convert between different modal data. Specifically, researchers use Generative Adversarial Networks (GANs) to achieve cross - modal conversion between Functional Network Connectivity (FNC) and T1 - weighted Structural Magnetic Resonance Imaging (T1) data. This research not only explores the application ability of generative models in dealing with specific disease datasets, but also evaluates the effectiveness of these models in retaining diagnostic patterns. ### Main problems 1. **Modality missing**: In actual neuroimaging studies, data of different modalities are often missing, which limits the comprehensiveness and accuracy of multi - modal analysis. 2. **Application of generative models**: Most existing generative model studies focus on control case datasets, while generative models for specific diseases and their ability to capture diagnostic patterns have not been fully explored. ### Solutions - **Cycle - GAN**: Researchers adopted Cycle - Generative Adversarial Network (Cycle - GAN) to synthesize FNC and T1 data. Cycle - GAN can perform modality conversion without paired data and improve the quality of generated data through Cycle Consistency Loss. - **Weak supervision**: In the case of paired data, researchers introduced a weak supervision mechanism to further enhance the performance of the model through Identity Loss. ### Experimental results - **Quantitative evaluation**: The Structural Similarity Index Measure (SSIM) of the generated T1 images reached 0.894 ± 0.003, and the Pearson Correlation of the generated FNC maps reached 0.707 ± 0.004. - **Qualitative evaluation**: The generated images are visually similar to the real data, especially for Alzheimer's patients. The generated T1 images show atrophy patterns in the hippocampus and other temporal lobe regions similar to the real data. In addition, the generated FNC maps also show functional connection changes consistent with the real data, such as increased functional connections in the cerebellum - sensorimotor network and cerebellum - visual network, and decreased functional connections in the cerebellum - subcortical, auditory - sensorimotor, sensorimotor - visual and cerebellum - cognitive control networks. ### Conclusion The research results show that the proposed GAN - based method can effectively capture and replicate the complex structural and functional brain patterns related to Alzheimer's disease. Future research can further explore the application of this generative method in downstream tasks, for example, by filling in missing modality data to improve the diagnostic accuracy of the disease.

Cross-Modality Translation with Generative Adversarial Networks to Unveil Alzheimer's Disease Biomarkers

Regional Brain Fusion: Graph Convolutional Network for Alzheimer's Disease Prediction and Analysis

Cross-Modal Transformer GAN: A Brain Structure-Function Deep Fusing Framework for Alzheimer's Disease

MRI to PET Cross-Modality Translation using Globally and Locally Aware GAN (GLA-GAN) for Multi-Modal Diagnosis of Alzheimer's Disease

Cross-Modality Generation of Amyloid PET from FDG PET for Alzheimer’s Disease Diagnosis

An interpretable generative multimodal neuroimaging-genomics framework for decoding Alzheimer's disease

Characterization Multimodal Connectivity of Brain Network by Hypergraph GAN for Alzheimer's Disease Analysis

Brain Status Transferring Generative Adversarial Network for Decoding Individualized Atrophy in Alzheimer's Disease

BG-GAN: Generative AI Enables Representing Brain Structure-Function Connections for Alzheimer's Disease

Multimodal Neuroimaging Data in Early Detection of Alzheimer's Disease: Exploring the Role of Ensemble Models and GAN Algorithm

Alzheimer's Disease Prediction via Brain Structural-Functional Deep Fusing Network

A comparative study of GNN and MLP based machine learning for the diagnosis of Alzheimer's Disease involving data synthesis

Enhancing Alzheimer's Disease Prediction: A Novel Approach to Leveraging GAN-Augmented Data for Improved CNN Model Accuracy

Cross-Modal Synthesis of Structural MRI and Functional Connectivity Networks via Conditional ViT-GANs

Enhancing magnetic resonance imaging-driven Alzheimer’s disease classification performance using generative adversarial learning

Multimodal transformer network for incomplete image generation and diagnosis of Alzheimer's disease

Morphological Feature Visualization of Alzheimer's Disease via Multidirectional Perception GAN

Alzheimer's Disease Classification Accuracy is Improved by MRI Harmonization based on Attention-Guided Generative Adversarial Networks

Bidirectional Mapping of Brain MRI and PET With 3D Reversible GAN for the Diagnosis of Alzheimer’s Disease

BrainNetGAN: Data augmentation of brain connectivity using generative adversarial network for dementia classification

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data