Trustworthy Enhanced Multi-view Multi-modal Alzheimer's Disease Prediction with Brain-wide Imaging Transcriptomics Data

Shan Cong,Zhoujie Fan,Hongwei Liu,Yinghan Zhang,Xin Wang,Haoran Luo,Xiaohui Yao
2024-06-21
Abstract:Brain transcriptomics provides insights into the molecular mechanisms by which the brain coordinates its functions and processes. However, existing multimodal methods for predicting Alzheimer's disease (AD) primarily rely on imaging and sometimes genetic data, often neglecting the transcriptomic basis of brain. Furthermore, while striving to integrate complementary information between modalities, most studies overlook the informativeness disparities between modalities. Here, we propose TMM, a trusted multiview multimodal graph attention framework for AD diagnosis, using extensive brain-wide transcriptomics and imaging data. First, we construct view-specific brain regional co-function networks (RRIs) from transcriptomics and multimodal radiomics data to incorporate interaction information from both biomolecular and imaging perspectives. Next, we apply graph attention (GAT) processing to each RRI network to produce graph embeddings and employ cross-modal attention to fuse transcriptomics-derived embedding with each imagingderived embedding. Finally, a novel true-false-harmonized class probability (TFCP) strategy is designed to assess and adaptively adjust the prediction confidence of each modality for AD diagnosis. We evaluate TMM using the AHBA database with brain-wide transcriptomics data and the ADNI database with three imaging modalities (AV45-PET, FDG-PET, and VBM-MRI). The results demonstrate the superiority of our method in identifying AD, EMCI, and LMCI compared to state-of-the-arts. Code and data are available at <a class="link-external link-https" href="https://github.com/Yaolab-fantastic/TMM" rel="external noopener nofollow">this https URL</a>.
Artificial Intelligence,Image and Video Processing
What problem does this paper attempt to address?
This paper aims to solve several key problems existing in the existing methods for Alzheimer's disease (AD) prediction: 1. **Insufficient utilization of multi - modal data**: Existing AD prediction methods mainly rely on imaging data (such as MRI, PET, etc.), and sometimes combine genetic data, but usually ignore the basis of brain transcriptomics. This leads to an incomplete understanding of the molecular mechanisms of the disease. 2. **The information differences between modalities are ignored**: Although many studies strive to integrate the complementary information between different modalities, most studies ignore the differences in the amount of information between different modalities. This difference is particularly evident among different samples and affects the reliability and interpretability of the model. To solve these problems, the author proposes a trusted multi - view multi - modal graph attention framework (Trusted Multi - view Multi - modal, TMM) for AD diagnosis. Specifically: - **Construct brain region co - function networks (RRIs) for specific views**: Construct transcriptomics - specific and imaging - specific RRIs from extensive brain transcriptomics data and multi - modal radiomics data to fuse the interaction information from the biomolecular and imaging perspectives. - **Apply graph attention processing**: Apply graph attention (Graph Attention, GAT) processing to each RRI network to generate graph embeddings, and fuse the transcriptomics - derived embeddings with each imaging - derived embedding through a cross - modal attention mechanism. - **Design a novel True - False - Harmonized Class Probability (TFCP) strategy**: Evaluate and adaptively adjust the prediction confidence of each modality to improve the accuracy of AD diagnosis. The paper evaluated TMM by using extensive brain transcriptomics data in the AHBA database and three imaging modalities (A V45 - PET, FDG - PET, VBM - MRI) in the ADNI database. The results show that this method is superior to existing methods in identifying AD, EMCI (early mild cognitive impairment), and LMCI (late mild cognitive impairment).