Abstract:Objective. Mild cognitive impairment (MCI) is a precursor to Alzheimer's disease (AD) which is an irreversible progressive neurodegenerative disease and its early diagnosis and intervention are of great significance. Recently, many deep learning methods have demonstrated the advantages of multi-modal neuroimages in MCI identification task. However, previous studies frequently simply concatenate patch-level features for prediction without modeling the dependencies among local features. Also, many methods only focus on modality-sharable information or modality-specific features and ignore their incorporation. This work aims to address above-mentioned issues and construct a model for accurate MCI identification.Approach. In this paper, we propose a multi-level fusion network for MCI identification using multi-modal neuroimages, which consists of local representation learning and dependency-aware global representation learning stages. Specifically, for each patient, we first extract multi-pair of patches from multiple same position in multi-modal neuroimages. After that, in the local representation learning stage, multiple dual-channel sub-networks, each of which consists of two modality-specific feature extraction branches and three sine-cosine fusion modules, are constructed to learn local features that preserve modality-sharable and modality specific representations simultaneously. In the dependency-aware global representation learning stage, we further capture long-range dependencies among local representations and integrate them into global ones for MCI identification.Main results. Experiments on ADNI-1/ADNI-2 datasets demonstrate the superior performance of the proposed method in MCI identification tasks (Accuracy: 0.802, sensitivity: 0.821, specificity: 0.767 in MCI diagnosis task; accuracy: 0.849, sensitivity: 0.841, specificity: 0.856 in MCI conversion task) when compared with state-of-the-art methods. The proposed classification model has demonstrated a promising potential to predict MCI conversion and identify the disease-related regions in the brain.Significance. We propose a multi-level fusion network for MCI identification using multi-modal neuroimage. The results on ADNI datasets have demonstrated its feasibility and superiority.

Mild Cognitive Impairment Classification Convolutional Neural Network with Attention Mechanism.

Attention-based and Micro Designed EfficientNetB2 for Diagnosis of Alzheimer’s Disease

Identifying Amnestic Mild Cognitive Impairment With Convolutional Neural Network Adapted to the Spectral Entropy Heat Map of the Electroencephalogram

Feature Classification Method of Resting-State EEG Signals From Amnestic Mild Cognitive Impairment With Type 2 Diabetes Mellitus Based on Multi-View Convolutional Neural Network

Detection of mild cognitive impairment based on attention mechanism and parallel dilated convolution

Detection of Mild Cognitive Impairment Using Convolutional Neural Network: Temporal-Feature Maps of Functional Near-Infrared Spectroscopy

Diagnosis of Alzheimer’s disease via an attention-based multi-scale convolutional neural network

A deep feature fusion network with global context and cross-dimensional dependencies for classification of mild cognitive impairment from brain MRI

Alzheimer's disease classification algorithm based on fusion of channel attention and densely connected networks

Convolutional Neural Networks-Based MRI Image Analysis for the Alzheimer’s Disease Prediction From Mild Cognitive Impairment

An End-to-end Multimodal 3D CNN Framework with Multi-level Features for the Prediction of Mild Cognitive Impairment

Mild Cognitive Impairment Identification Based on Multi-View Graph Convolutional Networks

Dual attention based fusion network for MCI Conversion Prediction

Ensemble of Convolutional Neural Networks and Multilayer Perceptron for the Diagnosis of Mild Cognitive Impairment and Alzheimer's Disease

Machine Learning of Cerebello-Cerebral Functional Networks for Mild Cognitive Impairment Detection

A Mild Cognitive Impairment Diagnostic Model Based on IAAFT and BiLSTM

Multi-level fusion network for mild cognitive impairment identification using multi-modal neuroimages

Identification of mild cognitive impairment using multimodal 3D imaging data and graph convolutional networks

MMHGE: Detecting Mild Cognitive Impairment Based on Multi-Atlas Multi-View Hybrid Graph Convolutional Networks and Ensemble Learning

Using a dual-stream attention neural network to characterize mild cognitive impairment based on retinal images

Convolutional Neural Network based on Feature Enhancement and Attention Mechanism for Alzheimer's Disease Prediction Using MRI Images