Abstract:Feature representations extracted from hippocampus in magnetic resonance (MR) images are widely used in computer-aided Alzheimer’s disease (AD) diagnosis, and thus accurate segmentation for the hippocampus has been remaining an active research topic. Previous studies for hippocampus segmentation require either human annotation which is tedious and error-prone or pre-processing MR images via time-consuming non-linear registration. Although many automatic segmentation approaches have been proposed, their performance is often limited by the small size of hippocampus and complex confounding information around the hippocampus. In particular, human-engineered features extracted from segmented hippocampus regions (e.g., the volume of the hippocampus) are essential for brain disease diagnosis, while these features are independent of diagnosis models, leading to sub-optimal performance. To address these issues, we propose a multi-task deep learning (MDL) method for joint hippocampus segmentation and clinical score regression using MR images. The prominent advantages of our MDL method lie on that we don’t need any time-consuming non-linear registration for pre-processing MR images, and features generated by MDL are consistent with subsequent diagnosis models. Specifically, we first align all MR images onto a standard template, followed by a patch extraction process to approximately locate hippocampus regions in the template space. Using image patches as input data, we develop a multi-task convolutional neural network (CNN) for joint hippocampus segmentation and clinical score regression. The proposed CNN network contains two subnetworks, including 1) a U-Net with a Dice-like loss function for hippocampus segmentation, and 2) a convolutional neural network with a mean squared loss function for clinical regression. Note that these two subnetworks share a part of network parameters, to exploit the inherent association between these two tasks. We evaluate the proposed method on 407 subjects with MRI data from baseline Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. The experimental results suggest that our MDL method achieves promising results in both tasks of hippocampus segmentation and clinical score regression, compared with several state-of-the-art methods.

MRI-based Multi-task Decoupling Learning for Alzheimer's Disease Detection and MMSE Score Prediction: A Multi-site Validation

Multi-Task Learning for Alzheimer's Disease Diagnosis and Mini-Mental State Examination Score Prediction

Multi-branch Multi-task 3D-CNN for Alzheimer's Disease Detection.

Dual Feature Correlation Guided Multi-Task Learning for Alzheimer's Disease Prediction.

MTFIL-Net: Automated Alzheimer’s Disease Detection and MMSE Score Prediction Based on Feature Interactive Learning

Correlation-aware Sparse and Low-rank Constrained Multi-task Learning for Longitudinal Analysis of Alzheimer's Disease.

Multi-Task Weakly-Supervised Attention Network for Dementia Status Estimation With Structural MRI

Multi-task Joint Learning Network Based on Adaptive Patch Pruning for Alzheimer’s Disease Diagnosis and Clinical Score Prediction

Integrating Convolutional Neural Networks and Multi-Task Dictionary Learning for Cognitive Decline Prediction with Longitudinal Images

Ranking Convolutional Neural Network for Alzheimer's Disease Mini-Mental State Examination Prediction at Multiple Time-Points

Spatio-Temporal Similarity Measure based Multi-Task Learning for Predicting Alzheimer's Disease Progression using MRI Data

Comparison of single and multitask learning for predicting cognitive decline based on MRI data

Modeling disease progression via multi-task learning

Multi-task Neural Networks for Joint Hippocampus Segmentation and Clinical Score Regression

Ranking convolutional neural network for Alzheimer’s disease mini-mental state examination prediction at multiple time-points

Feature-aware Multi-task Feature Learning for Predicting Cognitive Outcomes in Alzheimer's Disease

Multi-task multi-level feature adversarial network for joint Alzheimer’s disease diagnosis and atrophy localization using sMRI

Sparse Multi-kernel Based Multi-task Learning for Joint Prediction of Clinical Scores and Biomarker Identification in Alzheimer's Disease.

Double-attention Assisted Multi-task Learning for the Alzheimer’s Disease Prediction from Mild Cognitive Impairment*

End-to-End Dementia Status Prediction from Brain MRI Using Multi-task Weakly-Supervised Attention Network

Spatio-temporal Tensor Multi-Task Learning for Predicting Alzheimer's Disease in a Longitudinal study