Abstract:Background and Objective: For early identification of Alzheimer's disease (AD) based on multi-modal magnetic resonance imaging (MRI) data, it is important to make comprehensive use of image features and non-image information to analyze the gray matter atrophy and the structural/functional connectivity abnormalities for different courses of AD. Methods: In this study, we propose an extensible hierarchical graph convolutional network (EH-GCN) for early AD identification. Based on the extracted image features from multi-modal MRI data using the presented multi-branch residual network (ResNet), the brain regions-of-interests (ROIs) based GCN is built to extract structural and functional connectivity features between different ROIs of the brain. In order to further improve the performance of AD identification, an optimized spatial GCN is proposed as convolution operator in the population-based GCN to avoid rebuilding the graph network and take advantage of relationships between subjects. Finally, the proposed EH-GCN is built by embedding the image features and internal brain connectivity features into the spatial population-based GCN, which provides an extensible way to improve early AD identification performance by adding imaging features and non-image information from multi-modal data. Results: Experiments are performed on two datasets, which illustrate the effectiveness of the extracted structural/functional connectivity features and the high computational efficiency of the proposed method. The classification accuracy of AD vs NC, AD vs MCI and MCI vs NC classification tasks reaches 88.71% , 82.71% and 79.68% respectively. The extracted connectivity features between ROIs indicate that functional abnormalities are earlier than gray matter atrophy and abnormalities of structural connections, which is consistent with the clinical manifestations. The proposed method allows for the addition of other modal image features and non-image information from multi-modal data to continuously improve the performance of clinical data analysis. Conclusions: The proposed method can help us comprehensively analyze the role of gray matter atrophy, the damage of white matter nerve fiber tracts and the degradation of functional connectivity for different courses of AD, which could be useful for further extraction of clinical biomarkers for early AD identification.

Multimodal Hyperbolic Graph Learning for Alzheimer's Disease Detection

Regional Brain Fusion: Graph Convolutional Network for Alzheimer's Disease Prediction and Analysis

Multimodal Representations Learning and Adversarial Hypergraph Fusion for Early Alzheimer's Disease Prediction

Multi-Modal Diagnosis of Alzheimer's Disease using Interpretable Graph Convolutional Networks

Characterization Multimodal Connectivity of Brain Network by Hypergraph GAN for Alzheimer's Disease Analysis

Multi-modal Graph Neural Network for Early Diagnosis of Alzheimer's Disease from sMRI and PET Scans

Multigroup Recognition of Dementia Patients with Dynamic Brain Connectivity under Multimodal Cortex Parcellation

Interpretable Graph Convolutional Network Of Multi-Modality Brain Imaging For Alzheimer’s Disease Diagnosis

Multi-Modal Hypergraph Diffusion Network with Dual Prior for Alzheimer Classification

A Novel Multimodal MRI Analysis for Alzheimer's Disease Based on Convolutional Neural Network

Hypergraph-regularized multimodal learning by graph diffusion for imaging genetics based Alzheimer's Disease diagnosis

Multi-Hypergraph Learning for Incomplete Multimodality Data

Multi-Resolution Graph Analysis of Dynamic Brain Network for Classification of Alzheimer's Disease and Mild Cognitive Impairment

Multi-scale multimodal deep learning framework for Alzheimer's disease diagnosis

An Extensible Hierarchical Graph Convolutional Network for Early Alzheimer’s Disease Identification

A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseases

An Extensible Hierarchical Graph Convolutional Network for Early Alzheimer's Disease Identification

Patch-based Deep Multi-Modal Learning Framework for Alzheimer’s Disease Diagnosis Using Multi-View Neuroimaging

Bilevel Hypergraph Networks for Multi-Modal Alzheimer's Diagnosis

Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer's Disease using structural MR and FDG-PET images

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis