Abstract:Objective. Mild cognitive impairment (MCI) is a precursor to Alzheimer's disease (AD) which is an irreversible progressive neurodegenerative disease and its early diagnosis and intervention are of great significance. Recently, many deep learning methods have demonstrated the advantages of multi-modal neuroimages in MCI identification task. However, previous studies frequently simply concatenate patch-level features for prediction without modeling the dependencies among local features. Also, many methods only focus on modality-sharable information or modality-specific features and ignore their incorporation. This work aims to address above-mentioned issues and construct a model for accurate MCI identification.Approach. In this paper, we propose a multi-level fusion network for MCI identification using multi-modal neuroimages, which consists of local representation learning and dependency-aware global representation learning stages. Specifically, for each patient, we first extract multi-pair of patches from multiple same position in multi-modal neuroimages. After that, in the local representation learning stage, multiple dual-channel sub-networks, each of which consists of two modality-specific feature extraction branches and three sine-cosine fusion modules, are constructed to learn local features that preserve modality-sharable and modality specific representations simultaneously. In the dependency-aware global representation learning stage, we further capture long-range dependencies among local representations and integrate them into global ones for MCI identification.Main results. Experiments on ADNI-1/ADNI-2 datasets demonstrate the superior performance of the proposed method in MCI identification tasks (Accuracy: 0.802, sensitivity: 0.821, specificity: 0.767 in MCI diagnosis task; accuracy: 0.849, sensitivity: 0.841, specificity: 0.856 in MCI conversion task) when compared with state-of-the-art methods. The proposed classification model has demonstrated a promising potential to predict MCI conversion and identify the disease-related regions in the brain.Significance. We propose a multi-level fusion network for MCI identification using multi-modal neuroimage. The results on ADNI datasets have demonstrated its feasibility and superiority.

Multimodal Hyper-connectivity Networks for MCI Classification.

Identification of MCI individuals using structural and functional connectivity networks

Multiple Connection Pattern Combination from Single-Mode Data for Mild Cognitive Impairment Identification

Multimodal hyper-connectivity of functional networks using functionally-weighted LASSO for MCI classification.

Functional Connectivity Network Estimation with an Inter-Similarity Prior for Mild Cognitive Impairment Classification

Connectivity Strength‐weighted Sparse Group Representation‐based Brain Network Construction for MCI Classification

Novel Effective Connectivity Inference Using Ultra-Group Constrained Orthogonal Forward Regression and Elastic Multilayer Perceptron Classifier for MCI Identification.

Topological Properties Analysis and Identification of Mild Cognitive Impairment Based on Individual Morphological Brain Network Connectome.

Group Similarity Constraint Functional Brain Network Estimation for Mild Cognitive Impairment Classification

A Heterogeneous Graph Neural Network Fusing Functional and Structural Connectivity for MCI Diagnosis

Structural Connectivity Guided Sparse Effective Connectivity for MCI Identification.

Multi-modal Dynamic Graph Network: Coupling Structural and Functional Connectome for Disease Diagnosis and Classification

Feature Selection and Combination of Information in the Functional Brain Connectome for Discrimination of Mild Cognitive Impairment and Analyses of Altered Brain Patterns

Diagnosis of Early Mild Cognitive Impairment Based on Associated High-Order Functional Connection Network Generated by Multi-Modal MRI

Adaptive Functional Connectivity Network Using Parallel Hierarchical BiLSTM for MCI Diagnosis.

Resting-state Whole-Brain Functional Connectivity Networks for MCI Classification Using L2-regularized Logistic Regression.

Sparse Multivariate Autoregressive Modeling for Mild Cognitive Impairment Classification

Multi-level fusion network for mild cognitive impairment identification using multi-modal neuroimages

Identification of mild cognitive impairment using multimodal 3D imaging data and graph convolutional networks

Novel Effective Connectivity Network Inference for MCI Identification

Estimation of Discriminative Multimodal Brain Network Connectivity Using Message-Passing-Based Nonlinear Network Fusion.