Abstract:Accurate and early diagnosis of Alzheimer’s disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. Experimental results show that the proposed method achieves an accuracy of 93.26% for classification of AD vs. NC and 82.95% for classification pMCI vs. NC, demonstrating the promising classification performance.

An Effective Multimodal Image Fusion Method Using MRI and PET for Alzheimer's Disease Diagnosis

Multimodal Fusion Diagnosis of Alzheimer’s Disease Based on FDG-PET Generation

Multi-modal data Alzheimer’s disease detection based on 3D convolution

Multimodal Cross Enhanced Fusion Network for Diagnosis of Alzheimer's Disease and Subjective Memory Complaints.

Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease

Multimodal cross enhanced fusion network for diagnosis of Alzheimer?s disease and

Alzheimer’s Disease Diagnosis Via Multimodal Feature Fusion

A Fusion of Multi-view 2D and 3D Convolution Neural Network Based MRI for Alzheimer's Disease Diagnosis.

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis

Multi-scale multimodal deep learning framework for Alzheimer's disease diagnosis

Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis

Neuroimaging Modality Fusion in Alzheimer's Classification Using Convolutional Neural Networks

Patch-based Interpretable Deep Learning Framework for Alzheimer’s Disease Diagnosis Using Multimodal Data

MMTFN: Multi‐modal multi‐scale transformer fusion network for Alzheimer's disease diagnosis

Diagnosis of Alzheimer's Disease via Multi-modality 3D Convolutional Neural Network

HAMMF: Hierarchical Attention-Based Multi-Task and Multi-Modal Fusion Model for Computer-Aided Diagnosis of Alzheimer’s Disease

HAMMF: Hierarchical attention-based multi-task and multi-modal fusion model for computer-aided diagnosis of Alzheimer's disease

Diagnosis of Alzheimer’s Disease Via Multi-Modality 3D Convolutional Neural Network

CNNs Based Multi-Modality Classification for AD Diagnosis

Multimodal 3D Convolutional Neural Networks for Classification of Brain Disease Using Structural MR and FDG-PET Images.

[Research on classification method of multimodal magnetic resonance images of Alzheimer's disease based on generalized convolutional neural networks]