Abstract:Objective. Mild cognitive impairment (MCI) is a precursor to Alzheimer's disease (AD) which is an irreversible progressive neurodegenerative disease and its early diagnosis and intervention are of great significance. Recently, many deep learning methods have demonstrated the advantages of multi-modal neuroimages in MCI identification task. However, previous studies frequently simply concatenate patch-level features for prediction without modeling the dependencies among local features. Also, many methods only focus on modality-sharable information or modality-specific features and ignore their incorporation. This work aims to address above-mentioned issues and construct a model for accurate MCI identification.Approach. In this paper, we propose a multi-level fusion network for MCI identification using multi-modal neuroimages, which consists of local representation learning and dependency-aware global representation learning stages. Specifically, for each patient, we first extract multi-pair of patches from multiple same position in multi-modal neuroimages. After that, in the local representation learning stage, multiple dual-channel sub-networks, each of which consists of two modality-specific feature extraction branches and three sine-cosine fusion modules, are constructed to learn local features that preserve modality-sharable and modality specific representations simultaneously. In the dependency-aware global representation learning stage, we further capture long-range dependencies among local representations and integrate them into global ones for MCI identification.Main results. Experiments on ADNI-1/ADNI-2 datasets demonstrate the superior performance of the proposed method in MCI identification tasks (Accuracy: 0.802, sensitivity: 0.821, specificity: 0.767 in MCI diagnosis task; accuracy: 0.849, sensitivity: 0.841, specificity: 0.856 in MCI conversion task) when compared with state-of-the-art methods. The proposed classification model has demonstrated a promising potential to predict MCI conversion and identify the disease-related regions in the brain.Significance. We propose a multi-level fusion network for MCI identification using multi-modal neuroimage. The results on ADNI datasets have demonstrated its feasibility and superiority.

Double-attention Assisted Multi-task Learning for the Alzheimer’s Disease Prediction from Mild Cognitive Impairment*

Attention-based and Micro Designed EfficientNetB2 for Diagnosis of Alzheimer’s Disease

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data

Dual attention based fusion network for MCI Conversion Prediction

Prediction Of Mild Cognitive Impairment to Alzheimer’s Disease Conversion Via Machine Learning

Brain Connectivity Based Prediction of Alzheimer’s Disease in Patients with Mild Cognitive Impairment Based on Multi-Modal Images

Multi-modal Self-paced Locality Preserving Learning for Diagnosis of Alzheimer’s Disease

Multimodal multitask learning for predicting MCI to AD conversion using stacked polynomial attention network and adaptive exponential decay

Multi-Task Weakly-Supervised Attention Network for Dementia Status Estimation With Structural MRI

Label-aligned multi-task feature learning for multimodal classification of Alzheimer's disease and mild cognitive impairment

Multimodal Neuroimaging Attention-Based architecture for Cognitive Decline Prediction

Multi-modal discriminative dictionary learning for Alzheimer's disease and mild cognitive impairment

Detection of mild cognitive impairment based on attention mechanism and parallel dilated convolution

3-D CNN-Based Multichannel Contrastive Learning for Alzheimer's Disease Automatic Diagnosis

HAMMF: Hierarchical attention-based multi-task and multi-modal fusion model for computer-aided diagnosis of Alzheimer's disease

Multi-Task Learning for Alzheimer's Disease Diagnosis and Mini-Mental State Examination Score Prediction

Diagnosis of Alzheimer's disease by joining dual attention CNN and MLP based on structural MRIs, clinical and genetic data

Multi-view imputation and cross-attention network based on incomplete longitudinal and multimodal data for conversion prediction of mild cognitive impairment

Dual-3DM3AD: Mixed Transformer Based Semantic Segmentation and Triplet Pre-Processing for Early Multi-Class Alzheimer's Diagnosis

Multi-level fusion network for mild cognitive impairment identification using multi-modal neuroimages

Hybrid Multimodality Fusion with Cross-Domain Knowledge Transfer to Forecast Progression Trajectories in Cognitive Decline