Abstract:Accurate prediction of clinical scores (of neuropsychological tests) based on noninvasive structural magnetic resonance imaging (MRI) helps understand the pathological stage of dementia (e.g., Alzheimer's disease (AD)) and forecast its progression. Existing machine/deep learning approaches typically preselect dementia-sensitive brain locations for MRI feature extraction and model construction, potentially leading to undesired heterogeneity between different stages and degraded prediction performance. Besides, these methods usually rely on prior anatomical knowledge (e.g., brain atlas) and time-consuming nonlinear registration for the preselection of brain locations, thereby ignoring individual-specific structural changes during dementia progression because all subjects share the same preselected brain regions. In this article, we propose a multi-task weakly-supervised attention network (MWAN) for the joint regression of multiple clinical scores from baseline MRI scans. Three sequential components are included in MWAN: 1) a backbone fully convolutional network for extracting MRI features; 2) a weakly supervised dementia attention block for automatically identifying subject-specific discriminative brain locations; and 3) an attention-aware multitask regression block for jointly predicting multiple clinical scores. The proposed MWAN is an end-to-end and fully trainable deep learning model in which dementia-aware holistic feature learning and multitask regression model construction are integrated into a unified framework. Our MWAN method was evaluated on two public AD data sets for estimating clinical scores of mini-mental state examination (MMSE), clinical dementia rating sum of boxes (CDRSB), and AD assessment scale cognitive subscale (ADAS-Cog). Quantitative experimental results demonstrate that our method produces superior regression performance compared with state-of-the-art methods. Importantly, qualitative results indic-te that the dementia-sensitive brain locations automatically identified by our MWAN method well retain individual specificities and are biologically meaningful.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to non - invasively and accurately predict the clinical scores of neuropsychological tests based on structural magnetic resonance imaging (MRI) in the clinical assessment of dementias such as Alzheimer's disease (AD). Existing methods usually require pre - selecting brain regions sensitive to dementia for MRI feature extraction and model construction, which may lead to inconsistencies between different stages and rely on prior anatomical knowledge (such as brain atlases) and time - consuming nonlinear registration, thus ignoring the specific structural changes of individuals during the progression of dementia. In addition, these methods face challenges when dealing with continuous variable regression tasks, that is, predicting clinical scores. To this end, the paper proposes a Multi - Task Weakly - Supervised Attention Network (MWAN), aiming to automatically identify discriminative brain regions related to an individual's specific dementia state directly from whole - brain MRI scans and, on this basis, jointly predict multiple clinical scores. MWAN consists of three sequential components: 1) a backbone fully convolutional network (FCN) for extracting MRI features; 2) a weakly - supervised dementia attention block for automatically identifying individual - specific discriminative brain regions; 3) an attention - aware multitask regression block for jointly predicting multiple clinical scores. MWAN is an end - to - end and fully trainable deep - learning model, in which the overall dementia - aware feature learning and multi - task regression model construction are integrated into a unified framework. In this way, the paper aims to improve the accuracy of clinical score prediction while retaining individual specificity and ensuring biological significance.

Multi-Task Weakly-Supervised Attention Network for Dementia Status Estimation With Structural MRI

Attention-based and Micro Designed EfficientNetB2 for Diagnosis of Alzheimer’s Disease

Multi-task multi-level feature adversarial network for joint Alzheimer’s disease diagnosis and atrophy localization using sMRI

Multi-task Learning and Ensemble Approach to Predict Cognitive Scores for Patients with Alzheimer’s Disease

Multiscale Autoencoder with Structural-Functional Attention Network for Alzheimer's Disease Prediction

Double-attention Assisted Multi-task Learning for the Alzheimer’s Disease Prediction from Mild Cognitive Impairment*

Attention-guided 3D CNN With Lesion Feature Selection for Early Alzheimer's Disease Prediction Using Longitudinal sMRI

Alzheimer's Disease Diagnosis With Brain Structural MRI Using Multiview-Slice Attention and 3D Convolution Neural Network

MRI-based Multi-task Decoupling Learning for Alzheimer's Disease Detection and MMSE Score Prediction: A Multi-site Validation

An End-to-end Multimodal 3D CNN Framework with Multi-level Features for the Prediction of Mild Cognitive Impairment

Dual attention based fusion network for MCI Conversion Prediction

Attention-based 3D CNN with Multi-layer Features for Alzheimer's Disease Diagnosis using Brain Images

A multi-model deep convolutional neural network for automatic hippocampus segmentation and classification in Alzheimer’s disease

Ranking convolutional neural network for Alzheimer’s disease mini-mental state examination prediction at multiple time-points

Alzheimer's MRI Recognition Based on Convolutional Neural Networks

Diagnosis of Alzheimer's disease via optimized lightweight convolution-attention and structural MRI

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data

3D Convolutional Neural Networks with Hybrid Attention Mechanism for Early Diagnosis of Alzheimer's Disease

Lightweight neural network for Alzheimer's disease classification using multi-slice sMRI

An Attention-Based 3D CNN With Multi-Scale Integration Block for Alzheimer's Disease Classification

Predicting Future Clinical Changes of MCI Patients Using Longitudinal and Multimodal Biomarkers