Abstract:Accurate prediction of clinical scores (of neuropsychological tests) based on noninvasive structural magnetic resonance imaging (MRI) helps understand the pathological stage of dementia (e.g., Alzheimer's disease (AD)) and forecast its progression. Existing machine/deep learning approaches typically preselect dementia-sensitive brain locations for MRI feature extraction and model construction, potentially leading to undesired heterogeneity between different stages and degraded prediction performance. Besides, these methods usually rely on prior anatomical knowledge (e.g., brain atlas) and time-consuming nonlinear registration for the preselection of brain locations, thereby ignoring individual-specific structural changes during dementia progression because all subjects share the same preselected brain regions. In this article, we propose a multi-task weakly-supervised attention network (MWAN) for the joint regression of multiple clinical scores from baseline MRI scans. Three sequential components are included in MWAN: 1) a backbone fully convolutional network for extracting MRI features; 2) a weakly supervised dementia attention block for automatically identifying subject-specific discriminative brain locations; and 3) an attention-aware multitask regression block for jointly predicting multiple clinical scores. The proposed MWAN is an end-to-end and fully trainable deep learning model in which dementia-aware holistic feature learning and multitask regression model construction are integrated into a unified framework. Our MWAN method was evaluated on two public AD data sets for estimating clinical scores of mini-mental state examination (MMSE), clinical dementia rating sum of boxes (CDRSB), and AD assessment scale cognitive subscale (ADAS-Cog). Quantitative experimental results demonstrate that our method produces superior regression performance compared with state-of-the-art methods. Importantly, qualitative results indic-te that the dementia-sensitive brain locations automatically identified by our MWAN method well retain individual specificities and are biologically meaningful.

High-Order Laplacian Regularized Low-Rank Representation for Multimodal Dementia Diagnosis

Multigroup Recognition of Dementia Patients with Dynamic Brain Connectivity under Multimodal Cortex Parcellation

Deep Multi-modal Latent Representation Learning for Automated Dementia Diagnosis

Latent Representation Learning for Alzheimer's Disease Diagnosis with Incomplete Multi-Modality Neuroimaging and Genetic Data.

Attention-Guided Hybrid Network for Dementia Diagnosis with Structural MR Images

Multi-modal latent space inducing ensemble SVM classifier for early dementia diagnosis with neuroimaging data

Feature Learning and Fusion of Multimodality Neuroimaging and Genetic Data for Multi-status Dementia Diagnosis

Patch-based Deep Multi-Modal Learning Framework for Alzheimer’s Disease Diagnosis Using Multi-View Neuroimaging

Nonlinearity-aware Based Dimensionality Reduction and Over-Sampling for AD/MCI Classification from MRI Measures.

Effective Feature Learning and Fusion of Multimodality Data Using Stage-Wise Deep Neural Network for Dementia Diagnosis

Multi-Modal Data Analysis for Alzheimer’s Disease Diagnosis: An Ensemble Model Using Imagery and Genetic Features

Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer's Disease using structural MR and FDG-PET images

Multi-Task Weakly-Supervised Attention Network for Dementia Status Estimation With Structural MRI

Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis

A Novel Multimodal MRI Analysis for Alzheimer's Disease Based on Convolutional Neural Network

Multi-modality sparse representation-based classification for Alzheimer's disease and mild cognitive impairment

Identifying Alzheimer's Disease-Related Brain Regions from Multi-Modality Neuroimaging Data Using Sparse Composite Linear Discrimination Analysis.

Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer’s Disease using structural MR and FDG-PET images

A Multimodal Learning Machine Framework for Alzheimer’s Disease Diagnosis Based on Neuropsychological and Neuroimaging Data

Multi-modal Self-paced Locality Preserving Learning for Diagnosis of Alzheimer’s Disease

Multimodality Alzheimer's Disease Analysis in Deep Riemannian Manifold