Abstract:Background and Objective: For early identification of Alzheimer's disease (AD) based on multi-modal magnetic resonance imaging (MRI) data, it is important to make comprehensive use of image features and non-image information to analyze the gray matter atrophy and the structural/functional connectivity abnormalities for different courses of AD. Methods: In this study, we propose an extensible hierarchical graph convolutional network (EH-GCN) for early AD identification. Based on the extracted image features from multi-modal MRI data using the presented multi-branch residual network (ResNet), the brain regions-of-interests (ROIs) based GCN is built to extract structural and functional connectivity features between different ROIs of the brain. In order to further improve the performance of AD identification, an optimized spatial GCN is proposed as convolution operator in the population-based GCN to avoid rebuilding the graph network and take advantage of relationships between subjects. Finally, the proposed EH-GCN is built by embedding the image features and internal brain connectivity features into the spatial population-based GCN, which provides an extensible way to improve early AD identification performance by adding imaging features and non-image information from multi-modal data. Results: Experiments are performed on two datasets, which illustrate the effectiveness of the extracted structural/functional connectivity features and the high computational efficiency of the proposed method. The classification accuracy of AD vs NC, AD vs MCI and MCI vs NC classification tasks reaches 88.71% , 82.71% and 79.68% respectively. The extracted connectivity features between ROIs indicate that functional abnormalities are earlier than gray matter atrophy and abnormalities of structural connections, which is consistent with the clinical manifestations. The proposed method allows for the addition of other modal image features and non-image information from multi-modal data to continuously improve the performance of clinical data analysis. Conclusions: The proposed method can help us comprehensively analyze the role of gray matter atrophy, the damage of white matter nerve fiber tracts and the degradation of functional connectivity for different courses of AD, which could be useful for further extraction of clinical biomarkers for early AD identification.

A Hybrid Multi-Scale Attention Convolution and Aging Transformer Network for Alzheimer's Disease Diagnosis.

Attention-based and Micro Designed EfficientNetB2 for Diagnosis of Alzheimer’s Disease

Early Diagnosis of Alzheimer's Disease Using Deep Learning

Attention-Guided Hybrid Network for Dementia Diagnosis with Structural MR Images

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis

Diagnosis of Alzheimer’s disease via an attention-based multi-scale convolutional neural network

Diagnosis of Alzheimer's Disease via Multi-modality 3D Convolutional Neural Network

DMA-HPCNet: Dual Multi-level Attention Hybrid Pyramid Convolution Neural Network for Alzheimer’s Disease Classification#

MMTFN: Multi‐modal multi‐scale transformer fusion network for Alzheimer's disease diagnosis

A multi-model deep convolutional neural network for automatic hippocampus segmentation and classification in Alzheimer’s disease

An Extensible Hierarchical Graph Convolutional Network for Early Alzheimer’s Disease Identification

Attention-based 3D CNN with Multi-layer Features for Alzheimer's Disease Diagnosis using Brain Images

Diagnosis of Alzheimer's disease via optimized lightweight convolution-attention and structural MRI

Multiscale Autoencoder with Structural-Functional Attention Network for Alzheimer's Disease Prediction

DMA-HPCNet: Dual Multi-Level Attention Hybrid Pyramid Convolution Neural Network for Alzheimer's Disease Classification

A 3D densely connected convolution neural network with connection-wise attention mechanism for Alzheimer's disease classification

An Extensible Hierarchical Graph Convolutional Network for Early Alzheimer's Disease Identification

Alzheimer's Disease Classification Based on Combination of Multi-Model Convolutional Networks

LGG-NeXt: A Next Generation CNN and Transformer Hybrid Model for the Diagnosis of Alzheimer's Disease Using 2D Structural MRI

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data

Ensemble of Deep Convolutional Neural Networks Based Multi-Modality Images for Alzheimer's Disease Diagnosis