Abstract:Alzheimer's Disease (AD) is one of the most concerned neurodegenerative diseases. In the last decade, studies on AD diagnosis attached great significance to artificial intelligence (AI)-based diagnostic algorithms. Among the diverse modality imaging data, T1-weighted MRI and 18F-FDGPET are widely researched for this task. In this paper, we propose a novel convolutional neural network (CNN) to fuse the multi-modality information including T1-MRI and FDG-PDT images around the hippocampal area for the diagnosis of AD. Different from the traditional machine learning algorithms, this method does not require manually extracted features, and utilizes the stateof-art 3D image-processing CNNs to learn features for the diagnosis and prognosis of AD. To validate the performance of the proposed network, we trained the classifier with paired T1-MRI and FDG-PET images using the ADNI datasets, including 731 Normal (NL) subjects, 647 AD subjects, 441 stable MCI (sMCI) subjects and 326 progressive MCI (pMCI) subjects. We obtained the maximal accuracies of 90.10% for NL/AD task, 87.46% for NL/pMCI task, and 76.90% for sMCI/pMCI task. The proposed framework yields comparative results against state-of-the-art approaches. Moreover, the experimental results have demonstrated that (1) segmentation is not a prerequisite by using CNN, (2) the hippocampal area provides enough information to give a reference to AD diagnosis. Keywords: Alzheimer's Disease, Multi-modality, Image Classification, CNN, Deep Learning, Hippocampal

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve This paper aims to achieve accurate and automatic diagnosis of Alzheimer's Disease (AD) using a multimodal 3D Convolutional Neural Network (CNN). Specifically, the paper attempts to address the following key issues: 1. **Improving the accuracy of AD diagnosis**: - Utilizing multimodal information from T1-weighted MRI and 18F-FDG-PET images, the paper aims to improve the classification accuracy between AD and normal controls (NL), as well as mild cognitive impairment (MCI), through deep learning methods, particularly 3D CNN. 2. **Reducing the need for manual feature extraction**: - Traditional machine learning methods often require manual feature extraction. The proposed method in this paper eliminates the need for manual feature extraction by using advanced 3D image processing CNNs to automatically learn features. 3. **Verifying the necessity of segmentation**: - The paper investigates whether the segmentation step is necessary in CNN classification. Experiments show that segmentation is not a necessary step when using CNNs. 4. **Determining the information content of key regions**: - The paper verifies whether the hippocampal region provides sufficient information for AD diagnosis. The study shows that the ROI around the hippocampal region is sufficient to provide reference information. 5. **Early diagnosis of MCI progression**: - The method is extended to the classification task of stable MCI (sMCI) and progressive MCI (pMCI) to achieve early diagnosis of dementia, thereby assisting clinicians in proposing effective treatment interventions. ### Main Contributions 1. **Segmentation is not a necessary step**: - Experiments validate that segmentation of key substructures (such as the hippocampus) is not a required step in CNN-based classification. 2. **Hippocampal region provides sufficient information**: - It is demonstrated that an ROI containing the hippocampal region can provide sufficient information for AD diagnosis. 3. **Single-modality AD diagnosis**: - Achieved single-modality AD diagnosis based on a 3D VGG variant CNN. 4. **Multimodal information fusion**: - Introduced a new framework that fuses complementary information from multiple modalities into the proposed network for the classification tasks of NL/AD, NL/pMCI, and sMCI/pMCI. Through these studies, the paper provides new technologies and methods for the early diagnosis and prognosis of AD, which have significant clinical application value.

Diagnosis of Alzheimer's Disease via Multi-modality 3D Convolutional Neural Network

Diagnosis of Alzheimer’s Disease Via Multi-Modality 3D Convolutional Neural Network

A multi-model deep convolutional neural network for automatic hippocampus segmentation and classification in Alzheimer’s disease

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis

Early Diagnosis of Alzheimer's Disease Using Deep Learning

Attention-based 3D CNN with Multi-layer Features for Alzheimer's Disease Diagnosis using Brain Images

Alzheimer's Disease Classification Based on Combination of Multi-Model Convolutional Networks

Diagnosis of Alzheimer's Disease Based on Multi-Output Three-Dimensional Convolutional Neural Network

CNNs Based Multi-Modality Classification for AD Diagnosis

3-D CNN-Based Multichannel Contrastive Learning for Alzheimer's Disease Automatic Diagnosis

A Novel Multimodal MRI Analysis for Alzheimer's Disease Based on Convolutional Neural Network

Alzheimer's MRI Recognition Based on Convolutional Neural Networks

Diagnosis of Alzheimer’s disease via an attention-based multi-scale convolutional neural network

A Fusion of Multi-view 2D and 3D Convolution Neural Network Based MRI for Alzheimer's Disease Diagnosis.

3D Convolutional Networks Based Automatic Diagnosis of Alzheimer's Disease Using Structural MRI

3D CNN-based classification using sMRI and MD-DTI images for Alzheimer disease studies

Enhancing Alzheimer's Disease Classification Using 3D Convolutional Neural Network and Multilayer Perceptron Model with Attention Network

A Fast and Accurate 3D Fine-Tuning Convolutional Neural Network for Alzheimer’s Disease Diagnosis

Alzheimer's disease diagnosis framework from incomplete multimodal data using convolutional neural networks

Ensemble of Deep Convolutional Neural Networks Based Multi-Modality Images for Alzheimer's Disease Diagnosis

An Attention-Based 3D CNN With Multi-Scale Integration Block for Alzheimer's Disease Classification