Abstract:Background and Objective: For early identification of Alzheimer's disease (AD) based on multi-modal magnetic resonance imaging (MRI) data, it is important to make comprehensive use of image features and non-image information to analyze the gray matter atrophy and the structural/functional connectivity abnormalities for different courses of AD. Methods: In this study, we propose an extensible hierarchical graph convolutional network (EH-GCN) for early AD identification. Based on the extracted image features from multi-modal MRI data using the presented multi-branch residual network (ResNet), the brain regions-of-interests (ROIs) based GCN is built to extract structural and functional connectivity features between different ROIs of the brain. In order to further improve the performance of AD identification, an optimized spatial GCN is proposed as convolution operator in the population-based GCN to avoid rebuilding the graph network and take advantage of relationships between subjects. Finally, the proposed EH-GCN is built by embedding the image features and internal brain connectivity features into the spatial population-based GCN, which provides an extensible way to improve early AD identification performance by adding imaging features and non-image information from multi-modal data. Results: Experiments are performed on two datasets, which illustrate the effectiveness of the extracted structural/functional connectivity features and the high computational efficiency of the proposed method. The classification accuracy of AD vs NC, AD vs MCI and MCI vs NC classification tasks reaches 88.71% , 82.71% and 79.68% respectively. The extracted connectivity features between ROIs indicate that functional abnormalities are earlier than gray matter atrophy and abnormalities of structural connections, which is consistent with the clinical manifestations. The proposed method allows for the addition of other modal image features and non-image information from multi-modal data to continuously improve the performance of clinical data analysis. Conclusions: The proposed method can help us comprehensively analyze the role of gray matter atrophy, the damage of white matter nerve fiber tracts and the degradation of functional connectivity for different courses of AD, which could be useful for further extraction of clinical biomarkers for early AD identification.

Hierarchical Fully Convolutional Network for Joint Atrophy Localization and Alzheimer's Disease Diagnosis Using Structural MRI

Enhancing Alzheimer’s Disease Diagnosis Via Hierarchical 3D-FCN with Multi-Modal Features

Multi-task multi-level feature adversarial network for joint Alzheimer’s disease diagnosis and atrophy localization using sMRI

A multi-model deep convolutional neural network for automatic hippocampus segmentation and classification in Alzheimer’s disease

Attention-Guided Hybrid Network for Dementia Diagnosis with Structural MR Images

Diagnosis of Alzheimer's Disease via Multi-modality 3D Convolutional Neural Network

Attention-based 3D CNN with Multi-layer Features for Alzheimer's Disease Diagnosis using Brain Images

Alzheimer's MRI Recognition Based on Convolutional Neural Networks

Light-weight cross-view hierarchical fusion network for joint localization and identification in Alzheimer’s disease with adaptive instance-declined pruning

Alzheimer's Disease Classification Based on Combination of Multi-Model Convolutional Networks

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis

A Hybrid Multi-Scale Attention Convolution and Aging Transformer Network for Alzheimer's Disease Diagnosis.

3D Convolutional Networks Based Automatic Diagnosis of Alzheimer's Disease Using Structural MRI

Diagnosis of Alzheimer’s Disease Via Multi-Modality 3D Convolutional Neural Network

Ensemble of Convolutional Neural Networks and Multilayer Perceptron for the Diagnosis of Mild Cognitive Impairment and Alzheimer's Disease

Enhancing Alzheimer's disease diagnosis and staging: a multistage CNN framework using MRI

An Extensible Hierarchical Graph Convolutional Network for Early Alzheimer’s Disease Identification

A Fusion of Multi-view 2D and 3D Convolution Neural Network Based MRI for Alzheimer's Disease Diagnosis.

Multimodal Cross Enhanced Fusion Network for Diagnosis of Alzheimer's Disease and Subjective Memory Complaints.

An Extensible Hierarchical Graph Convolutional Network for Early Alzheimer's Disease Identification

Improve 3D Feature Extraction and Fusion for Stage Diagnosis of Alzheimer’s Disease