Abstract:Accurate prediction of clinical scores (of neuropsychological tests) based on noninvasive structural magnetic resonance imaging (MRI) helps understand the pathological stage of dementia (e.g., Alzheimer's disease (AD)) and forecast its progression. Existing machine/deep learning approaches typically preselect dementia-sensitive brain locations for MRI feature extraction and model construction, potentially leading to undesired heterogeneity between different stages and degraded prediction performance. Besides, these methods usually rely on prior anatomical knowledge (e.g., brain atlas) and time-consuming nonlinear registration for the preselection of brain locations, thereby ignoring individual-specific structural changes during dementia progression because all subjects share the same preselected brain regions. In this article, we propose a multi-task weakly-supervised attention network (MWAN) for the joint regression of multiple clinical scores from baseline MRI scans. Three sequential components are included in MWAN: 1) a backbone fully convolutional network for extracting MRI features; 2) a weakly supervised dementia attention block for automatically identifying subject-specific discriminative brain locations; and 3) an attention-aware multitask regression block for jointly predicting multiple clinical scores. The proposed MWAN is an end-to-end and fully trainable deep learning model in which dementia-aware holistic feature learning and multitask regression model construction are integrated into a unified framework. Our MWAN method was evaluated on two public AD data sets for estimating clinical scores of mini-mental state examination (MMSE), clinical dementia rating sum of boxes (CDRSB), and AD assessment scale cognitive subscale (ADAS-Cog). Quantitative experimental results demonstrate that our method produces superior regression performance compared with state-of-the-art methods. Importantly, qualitative results indic-te that the dementia-sensitive brain locations automatically identified by our MWAN method well retain individual specificities and are biologically meaningful.

End-to-End Dementia Status Prediction from Brain MRI Using Multi-task Weakly-Supervised Attention Network

Multi-Task Weakly-Supervised Attention Network for Dementia Status Estimation With Structural MRI

Attention-Guided Hybrid Network for Dementia Diagnosis with Structural MR Images

Weakly Supervised Deep Learning for Brain Disease Prognosis Using MRI and Incomplete Clinical Scores

Multi-task multi-level feature adversarial network for joint Alzheimer’s disease diagnosis and atrophy localization using sMRI

Multi-branch Multi-task 3D-CNN for Alzheimer's Disease Detection.

Double-attention Assisted Multi-task Learning for the Alzheimer’s Disease Prediction from Mild Cognitive Impairment*

An End-to-end Multimodal 3D CNN Framework with Multi-level Features for the Prediction of Mild Cognitive Impairment

Multi-task Learning and Ensemble Approach to Predict Cognitive Scores for Patients with Alzheimer’s Disease

Attention-Guided Deep Domain Adaptation for Brain Dementia Identification with Multi-site Neuroimaging Data.

Multiscale Autoencoder with Structural-Functional Attention Network for Alzheimer's Disease Prediction

MRI-based Multi-task Decoupling Learning for Alzheimer's Disease Detection and MMSE Score Prediction: A Multi-site Validation

Attention-guided 3D CNN With Lesion Feature Selection for Early Alzheimer's Disease Prediction Using Longitudinal sMRI

A Weakly Supervised Deep Learning Model for Alzheimer’s Disease Prognosis Using MRI and Incomplete Labels

Attention-based 3D CNN with Multi-layer Features for Alzheimer's Disease Diagnosis using Brain Images

Multi-site MRI Harmonization Via Attention-Guided Deep Domain Adaptation for Brain Disorder Identification.

Multi-task Joint Learning Network Based on Adaptive Patch Pruning for Alzheimer’s Disease Diagnosis and Clinical Score Prediction

Integrating Convolutional Neural Networks and Multi-Task Dictionary Learning for Cognitive Decline Prediction with Longitudinal Images

Multi-view prediction of Alzheimer’s disease progression with end-to-end integrated framework

A Hybrid Multi-Scale Attention Convolution and Aging Transformer Network for Alzheimer's Disease Diagnosis.

Convolutional Neural Network based on Feature Enhancement and Attention Mechanism for Alzheimer's Disease Prediction Using MRI Images