Abstract:Detection of AD at the earlier symptomatic stage of mild cognitive impairment (MCI) is important for effective therapeutic intervention. Because MCI is a research construct that has heterogeneous etiologies, it is an important task to differentiate if an individual with MCI has early ongoing AD pathology (a.k.a. MCI due to AD). This can be accomplished by building a machine learning classifier to integrate images of different but complementary modalities together with clinical variables. The challenge is that multi-modality images are not universally available for all patients due to accessibility constraints (cost, insurance coverage, etc). In a previous study, we developed a transfer learning (TL) model capable of training a classifier using incomplete multi-modality images collected at baseline. In the present study, we include longitudinal multi-modality images in the TL model to further improve the classification accuracy. 214 MCI patients from ADNI were included. We downloaded MRI, FDG-PET, and amyloid-PET images (as three modalities) at baseline and a follow up. 97 patients were found to be Aβ+ at the follow up, an indicator of MCI due to AD. The patients were divided into four sub-cohorts: MRI only; MRI & FDG-PET; MRI & amyloid-PET; all three modalities available. We extracted commonly used imaging features including 3, 4, and 6 features from MRI, FDG-PET, and amyloid-PET, respectively. Clinical variables such as age, APOE 4 status, MMSE and CDR were also included. We applied TL to integrate the incomplete longitudinal multi-modality image features and clinical variables to build a classifier to differentiate MCI due to AD at the follow up. TL achieved 0.92 cross-validated AUC, 0.90 sensitivity, and 0.84 specificity. This is a significant improvement over using baseline images only (p<0.001). As a competing method, separate modeling of each sub-cohort by logistic regression achieved 0.86 AUC, 0.83 sensitivity, and 0.83 specificity, which were significantly outperformed by TL in AUC (p<0.001) and sensitivity (p<0.001). We proposed a novel TL model to accurately detect MCI due to AD for patients with varying availability of imaging modalities. This capability benefited a broader patient population especially those susceptible to resource or accessibility constraints.

Addressing Imaging Accessibility by Cross-Modality Transfer Learning

ADDRESSING THE GAP OF IMAGING ACCESSIBILITY IN EARLY DETECTION OF AD BY A NOVEL TRANSFER LEARNING MODEL: A LONGITUDINAL STUDY

ADMultiImg: a Novel Missing Modality Transfer Learning Based CAD System for Diagnosis of MCI Due to AD Using Incomplete Multi-Modality Imaging Data.

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data

Adversarial Transfer Learning for Alzheimer's Disease Diagnosis Using Structural MRI

IDENTIFICATION OF FAST CONVERTERS AMONG MCI PATIENTS BY INTEGRATING INCOMPLETE MULTI-MODALITY IMAGE DATA USING A LONGITUDINAL TRANSFER LEARNING MODEL

MDMA: Multimodal Data and Multi-attention Based Deep Learning Model for Alzheimer’s Disease Diagnosis

Double-attention Assisted Multi-task Learning for the Alzheimer’s Disease Prediction from Mild Cognitive Impairment*

Hybrid Multimodality Fusion with Cross-Domain Knowledge Transfer to Forecast Progression Trajectories in Cognitive Decline

Multi-modality sparse representation-based classification for Alzheimer's disease and mild cognitive impairment

A Cross-Modal Mutual Knowledge Distillation Framework for Alzheimer's Disease Diagnosis: Addressing Incomplete Modalities

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis

A Transfer Learning Approach for Early Diagnosis of Alzheimer’s Disease on MRI Images

Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer's Disease using structural MR and FDG-PET images

Joint Learning Framework of Cross-Modal Synthesis and Diagnosis for Alzheimer's Disease by Mining Underlying Shared Modality Information.

HAMMF: Hierarchical Attention-Based Multi-Task and Multi-Modal Fusion Model for Computer-Aided Diagnosis of Alzheimer’s Disease

Multi-task Sparse Classifier for Diagnosis of MCI Conversion to AD with Longitudinal MR Images

Re-transfer learning and multi-modal learning assisted early diagnosis of Alzheimer’s disease

Joint learning framework of cross-modal synthesis and diagnosis for Alzheimer’s disease by mining underlying shared modality information

Brain Connectivity Based Prediction of Alzheimer’s Disease in Patients with Mild Cognitive Impairment Based on Multi-Modal Images

Multimodal multitask learning for predicting MCI to AD conversion using stacked polynomial attention network and adaptive exponential decay