Abstract:Objective. Mild cognitive impairment (MCI) is a precursor to Alzheimer's disease (AD) which is an irreversible progressive neurodegenerative disease and its early diagnosis and intervention are of great significance. Recently, many deep learning methods have demonstrated the advantages of multi-modal neuroimages in MCI identification task. However, previous studies frequently simply concatenate patch-level features for prediction without modeling the dependencies among local features. Also, many methods only focus on modality-sharable information or modality-specific features and ignore their incorporation. This work aims to address above-mentioned issues and construct a model for accurate MCI identification.Approach. In this paper, we propose a multi-level fusion network for MCI identification using multi-modal neuroimages, which consists of local representation learning and dependency-aware global representation learning stages. Specifically, for each patient, we first extract multi-pair of patches from multiple same position in multi-modal neuroimages. After that, in the local representation learning stage, multiple dual-channel sub-networks, each of which consists of two modality-specific feature extraction branches and three sine-cosine fusion modules, are constructed to learn local features that preserve modality-sharable and modality specific representations simultaneously. In the dependency-aware global representation learning stage, we further capture long-range dependencies among local representations and integrate them into global ones for MCI identification.Main results. Experiments on ADNI-1/ADNI-2 datasets demonstrate the superior performance of the proposed method in MCI identification tasks (Accuracy: 0.802, sensitivity: 0.821, specificity: 0.767 in MCI diagnosis task; accuracy: 0.849, sensitivity: 0.841, specificity: 0.856 in MCI conversion task) when compared with state-of-the-art methods. The proposed classification model has demonstrated a promising potential to predict MCI conversion and identify the disease-related regions in the brain.Significance. We propose a multi-level fusion network for MCI identification using multi-modal neuroimage. The results on ADNI datasets have demonstrated its feasibility and superiority.

Deep Fusion of Brain Structure-Function in Mild Cognitive Impairment

Regional Brain Fusion: Graph Convolutional Network for Alzheimer's Disease Prediction and Analysis

Fusing Structural and Functional Connectivities using Disentangled VAE for Detecting MCI

Brain Structure-Function Fusing Representation Learning using Adversarial Decomposed-VAE for Analyzing MCI

Multi-level fusion network for mild cognitive impairment identification using multi-modal neuroimages

A deep feature fusion network with global context and cross-dimensional dependencies for classification of mild cognitive impairment from brain MRI

Multigroup Recognition of Dementia Patients with Dynamic Brain Connectivity under Multimodal Cortex Parcellation

Alzheimer's Disease Prediction via Brain Structural-Functional Deep Fusing Network

Functional Connectivity Network Estimation with an Inter-Similarity Prior for Mild Cognitive Impairment Classification

Diagnosis of Early Mild Cognitive Impairment Based on Associated High-Order Functional Connection Network Generated by Multi-Modal MRI

Deep Fusion of Multi-Template using Spatio-Temporal Weighted Multi-Hypergraph Convolutional Networks for Brain Disease Analysis

Enhancing Early Alzheimer's Disease Classification Accuracy Through the Fusion of Smri and Rsmeg Data: a Deep Learning Approach

Deep Spatial-Temporal Feature Fusion from Adaptive Dynamic Functional Connectivity for MCI Identification.

Multimodal Cross Enhanced Fusion Network for Diagnosis of Alzheimer's Disease and Subjective Memory Complaints.

Modality-Aware Discriminative Fusion Network for Integrated Analysis of Brain Imaging Genomics

Identification of mild cognitive impairment using multimodal 3D imaging data and graph convolutional networks

Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis

Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease

Persistent Feature Analysis of Multimodal Brain Networks Using Generalized Fused Lasso for EMCI Identification

Ensemble of Convolutional Neural Networks and Multilayer Perceptron for the Diagnosis of Mild Cognitive Impairment and Alzheimer's Disease

Multimodal cross enhanced fusion network for diagnosis of Alzheimer?s disease and