Abstract:Alzheimer's disease (AD) is a severe irreversible neurodegenerative disease that has great sufferings on patients and eventually leads to death. Early detection of AD and its prodromal stage, mild cognitive impairment (MCI) which can be either stable (sMCI) or progressive (pMCI), is highly desirable for effective treatment planning and tailoring therapy. Recent studies recommended using multimodal data fusion of genetic (single nucleotide polymorphisms, SNPs) and neuroimaging data (magnetic resonance imaging (MRI) and positron emission tomography (PET)) to discriminate AD/MCI from normal control (NC) subjects. However, missing multimodal data in the cohort under study is inevitable. In addition, data heterogeneity between phenotypes and genotypes biomarkers makes learning capability of the models more challenging. Also, the current studies mainly focus on identifying brain disease classification and ignoring the regression task. Furthermore, they utilize multistage for predicting the brain disease progression. To address these issues, we propose a novel multimodal neuroimaging and genetic data fusion for joint classification and clinical score regression tasks using the maximum number of available samples in one unified framework using convolutional neural network (CNN). Specifically, we initially perform a technique based on linear interpolation to fill the missing features for each incomplete sample. Then, we learn the neuroimaging features from MRI, PET, and SNPs using CNN to alleviate the heterogeneity among genotype and phenotype data. Meanwhile, the high learned features from each modality are combined for jointly identifying brain diseases and predicting clinical scores. To validate the performance of the proposed method, we test our method on 805 subjects from Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Also, we verify the similarity between the synthetic and real data using statistical analysis. Moreover, the experimental results demonstrate that the proposed method can yield better performance in both classification and regression tasks. Specifically, our proposed method achieves accuracy of 98.22%, 93.11%, and 97.35% for NC vs. AD, NC vs. sMCI, and NC vs. pMCI, respectively. On the other hand, our method attains the lowest root mean square error and the highest correlation coefficient for different clinical scores regression tasks compared with the state-of-the-art methods.

A Survey on Computer-Aided Diagnosis of Brain Disorders through MRI Based on Machine Learning and Data Mining Methodologies with an Emphasis on Alzheimer Disease Diagnosis and the Contribution of the Multimodal Fusion

Computer-Aided Diagnosis System of Alzheimer's Disease Based on Multimodal Fusion: Tissue Quantification Based on the Hybrid Fuzzy-Genetic-Possibilistic Model and Discriminative Classification Based on the SVDD Model

Multimodal magnetic resonance imaging for Alzheimer's disease diagnosis using hybrid features extraction and ensemble support vector machines

An Effective Multimodal Image Fusion Method Using MRI and PET for Alzheimer's Disease Diagnosis

Computer aided diagnosis system for Alzheimers disease using principal component analysis and machine learning based approaches

An automatic Computer-Aided Diagnosis system based on the Multimodal fusion of Breast Cancer (MF-CAD)

3D CNN-based classification using sMRI and MD-DTI images for Alzheimer disease studies

Research on Computer-Aided Diagnosis of Alzheimer's Disease Based on Heterogeneous Medical Data Fusion.

Diagnosis of Alzheimer’s Disease by Canonical Correlation Analysis Based Fusion of Multi-Modal Medical Images

Recognition of Alzheimer's disease and Mild Cognitive Impairment with multimodal image-derived biomarkers and Multiple Kernel Learning

A Personalized Computer-Aided Diagnosis System for Mild Cognitive Impairment (MCI) Using Structural MRI (sMRI)

A Review on Multimodal Brain Image Fusion using Deep Learning for Alzheimer's disease

Automatic Detection of Alzheimer's Disease with Multi-Modal Fusion of Clinical MRI Scans

Automated Diagnosis and Prediction of Alzheimer Disease Using Magnetic Resonance Image.

ADMultiImg: a Novel Missing Modality Transfer Learning Based CAD System for Diagnosis of MCI Due to AD Using Incomplete Multi-Modality Imaging Data.

Machine Learning for Diagnosis of AD and Prediction of MCI Progression From Brain MRI Using Brain Anatomical Analysis Using Diffeomorphic Deformation

A Fusion of Multi-view 2D and 3D Convolution Neural Network Based MRI for Alzheimer's Disease Diagnosis.

Alzheimer's disease diagnosis framework from incomplete multimodal data using convolutional neural networks

Multi-scale multimodal deep learning framework for Alzheimer's disease diagnosis

Automated Detection of Alzheimer’s Disease Using Brain MRI Images– A Study with Various Feature Extraction Techniques

Alzheimer’s Disease Diagnosis Via Multimodal Feature Fusion