Abstract:Feature representations extracted from hippocampus in magnetic resonance (MR) images are widely used in computer-aided Alzheimer’s disease (AD) diagnosis, and thus accurate segmentation for the hippocampus has been remaining an active research topic. Previous studies for hippocampus segmentation require either human annotation which is tedious and error-prone or pre-processing MR images via time-consuming non-linear registration. Although many automatic segmentation approaches have been proposed, their performance is often limited by the small size of hippocampus and complex confounding information around the hippocampus. In particular, human-engineered features extracted from segmented hippocampus regions (e.g., the volume of the hippocampus) are essential for brain disease diagnosis, while these features are independent of diagnosis models, leading to sub-optimal performance. To address these issues, we propose a multi-task deep learning (MDL) method for joint hippocampus segmentation and clinical score regression using MR images. The prominent advantages of our MDL method lie on that we don’t need any time-consuming non-linear registration for pre-processing MR images, and features generated by MDL are consistent with subsequent diagnosis models. Specifically, we first align all MR images onto a standard template, followed by a patch extraction process to approximately locate hippocampus regions in the template space. Using image patches as input data, we develop a multi-task convolutional neural network (CNN) for joint hippocampus segmentation and clinical score regression. The proposed CNN network contains two subnetworks, including 1) a U-Net with a Dice-like loss function for hippocampus segmentation, and 2) a convolutional neural network with a mean squared loss function for clinical regression. Note that these two subnetworks share a part of network parameters, to exploit the inherent association between these two tasks. We evaluate the proposed method on 407 subjects with MRI data from baseline Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. The experimental results suggest that our MDL method achieves promising results in both tasks of hippocampus segmentation and clinical score regression, compared with several state-of-the-art methods.

An Optimized PatchMatch for Multi-scale and Multi-feature Label Fusion

Patch-Based Label Fusion with Structured Discriminant Embedding for Hippocampus Segmentation

Adapting the Segment Anything Model for Multi-modal Retinal Anomaly Detection and Localization

Patch-Based Hippocampus Segmentation Using a Local Subspace Learning Method

A Robust Discriminative Multi-Atlas Label Fusion Method for Hippocampus Segmentation from MR Image

Fusion of Multi-Size Candidate Regions Enhances Two-Stage Hippocampus Segmentation

Multi-task Neural Networks for Joint Hippocampus Segmentation and Clinical Score Regression

Label Fusion for Segmentation Via Patch Based on Local Weighted Voting

Bayesian Spatial Binary Regression for Label Fusion in Structural Neuroimaging

Hippocampus Segmentation Based on Iterative Local Linear Mapping With Representative and Local Structure-Preserved Feature Embedding

Patch-Based Surface Morphometry Feature Selection with Federated Group Lasso Regression

An Improved Label Fusion Approach with Sparse Patch-Based Representation for MRI Brain Image Segmentation.

Patch-based Interpretable Deep Learning Framework for Alzheimer’s Disease Diagnosis Using Multimodal Data

Label Fusion Method Based on Sparse Patch Representation for the Brain Mri Image Segmentation

Patch-based Deep Multi-Modal Learning Framework for Alzheimer’s Disease Diagnosis Using Multi-View Neuroimaging

Minimizing Joint Risk of Mislabeling for Iterative Patch-Based Label Fusion

Patch-based Label Fusion for Automatic Multi-Atlas-based Prostate Segmentation in MR Images

Automatic Segmentation of Hippocampal Subfields Based on Multi-Atlas Image Segmentation Techniques

Patch-Based Techniques in Medical Imaging

An Effective Multimodal Image Fusion Method Using MRI and PET for Alzheimer's Disease Diagnosis

Robust machine learning segmentation for large-scale analysis of heterogeneous clinical brain MRI datasets