Abstract:BACKGROUND AND OBJECTIVE:For early identification of Alzheimer's disease (AD) based on multi-modal magnetic resonance imaging (MRI) data, it is important to make comprehensive use of image features and non-image information to analyze the gray matter atrophy and the structural/functional connectivity abnormalities for different courses of AD.METHODS:In this study, we propose an extensible hierarchical graph convolutional network (EH-GCN) for early AD identification. Based on the extracted image features from multi-modal MRI data using the presented multi-branch residual network (ResNet), the brain regions-of-interests (ROIs) based GCN is built to extract structural and functional connectivity features between different ROIs of the brain. In order to further improve the performance of AD identification, an optimized spatial GCN is proposed as convolution operator in the population-based GCN to avoid rebuilding the graph network and take advantage of relationships between subjects. Finally, the proposed EH-GCN is built by embedding the image features and internal brain connectivity features into the spatial population-based GCN, which provides an extensible way to improve early AD identification performance by adding imaging features and non-image information from multi-modal data.RESULTS:Experiments are performed on two datasets, which illustrate the effectiveness of the extracted structural/functional connectivity features and the high computational efficiency of the proposed method. The classification accuracy of AD vs NC, AD vs MCI and MCI vs NC classification tasks reaches 88.71%, 82.71% and 79.68% respectively. The extracted connectivity features between ROIs indicate that functional abnormalities are earlier than gray matter atrophy and abnormalities of structural connections, which is consistent with the clinical manifestations. The proposed method allows for the addition of other modal image features and non-image information from multi-modal data to continuously improve the performance of clinical data analysis.CONCLUSIONS:The proposed method can help us comprehensively analyze the role of gray matter atrophy, the damage of white matter nerve fiber tracts and the degradation of functional connectivity for different courses of AD, which could be useful for further extraction of clinical biomarkers for early AD identification.

Light-weight cross-view hierarchical fusion network for joint localization and identification in Alzheimer’s disease with adaptive instance-declined pruning

Regional Brain Fusion: Graph Convolutional Network for Alzheimer's Disease Prediction and Analysis

Attention-based and Micro Designed EfficientNetB2 for Diagnosis of Alzheimer’s Disease

Hierarchical Fully Convolutional Network for Joint Atrophy Localization and Alzheimer's Disease Diagnosis Using Structural MRI

A Fusion of Multi-view 2D and 3D Convolution Neural Network Based MRI for Alzheimer's Disease Diagnosis.

Multi-task multi-level feature adversarial network for joint Alzheimer’s disease diagnosis and atrophy localization using sMRI

Early Diagnosis of Alzheimer’s Disease Based on Selective Kernel Network with Spatial Attention

Enhancing Alzheimer’s Disease Diagnosis Via Hierarchical 3D-FCN with Multi-Modal Features

Deep Joint Learning of Pathological Region Localization and Alzheimer's Disease Diagnosis

Attention-Guided Hybrid Network for Dementia Diagnosis with Structural MR Images

sMRI-PatchNet: A novel explainable patch-based deep learning network for Alzheimer's disease diagnosis and discriminative atrophy localisation with Structural MRI

A Hybrid Multi-Scale Attention Convolution and Aging Transformer Network for Alzheimer's Disease Diagnosis.

Multi-task Joint Learning Network Based on Adaptive Patch Pruning for Alzheimer’s Disease Diagnosis and Clinical Score Prediction

A multi-slice attention fusion and multi-view personalized fusion lightweight network for Alzheimer's disease diagnosis

A multi-model deep convolutional neural network for automatic hippocampus segmentation and classification in Alzheimer’s disease

Deep joint learning diagnosis of Alzheimer's disease based on multimodal feature fusion

Patch-based Deep Multi-Modal Learning Framework for Alzheimer’s Disease Diagnosis Using Multi-View Neuroimaging

Multimodal Cross Enhanced Fusion Network for Diagnosis of Alzheimer's Disease and Subjective Memory Complaints.

An Extensible Hierarchical Graph Convolutional Network for Early Alzheimer’s Disease Identification

Improve 3D Feature Extraction and Fusion for Stage Diagnosis of Alzheimer’s Disease

Patch-based Interpretable Deep Learning Framework for Alzheimer’s Disease Diagnosis Using Multimodal Data