Abstract:Background and Objectives Reliable detection of white matter hyperintensities (WMH) is crucial for studying the impact of diffuse white-matter pathology on brain health and monitoring changes in WMH load over time. However, manual annotation of 3D high-dimensional neuroimages is laborious and can be prone to biases and errors in the annotation procedure. In this study, we evaluate the performance of deep learning (DL) segmentation tools and propose a novel volumetric segmentation model incorporating self-attention via a transformer-based architecture. Ultimately, we aim to evaluate diverse factors that influence WMH segmentation, aiming for a comprehensive analysis of the state-of-the-art algorithms in a broader context. Methods We trained state-of-the-art DL algorithms, and incorporated advanced attention mechanisms, using structural fluid-attenuated inversion recovery (FLAIR) image acquisitions. The anatomical MRI data utilized for model training was obtained from healthy individuals aged 62-70 years in the LIve active Successful Aging (LISA) project. Given the potential sparsity of lesion volume among healthy aging individuals, we explored the impact of incorporating a weighted loss function and ensemble models. To assess the generalizability of the studied DL models, we applied the trained algorithm to an independent subset of data sourced from the MICCAI WMH challenge (MWSC). Notably, this subset had vastly different acquisition parameters compared to the LISA dataset used for training. Results Consistently, DL approaches exhibited commendable segmentation performance, achieving the level of inter-rater agreement comparable to expert performance, ensuring superior quality segmentation outcomes. On the out of sample dataset, the ensemble models exhibited the most outstanding performance. Conclusions DL methods generally surpassed conventional approaches in our study. While all DL methods performed comparably, incorporating attention mechanisms could prove advantageous in future applications with a wider availability of training data. As expected, our experiments indicate that the use of ensemble-based models enables the superior generalization in out-of-distribution settings. We believe that introducing DL methods in the WHM annotation workflow in heathy aging cohorts is promising, not only for reducing the annotation time required, but also for eventually improving accuracy and robustness via incorporating the automatic segmentations in the evaluation procedure.

Deeply Supervised Multi-Scale Fully Convolutional Networks for Segmentation of White Matter Hyperintensities

White matter hyperintensity segmentation from T1 and FLAIR images using fully convolutional neural networks enhanced with residual connections

Fully Convolutional Network Ensembles for White Matter Hyperintensities Segmentation in MR Images

Multi-stream 3D FCN with multi-scale deep supervision for multi-modality isointense infant brain MR image segmentation

Deep convolutional neural network for accurate segmentation and quantification of white matter hyperintensities.

Fully Automatic White Matter Hyperintensity Segmentation Using U-net and Skip Connection.

White matter hyperintensities segmentation using an ensemble of neural networks

Dsms-Fcn: A Deeply Supervised Multi-Scale Fully Convolutional Network For Automatic Segmentation Of Intervertebral Disc In 3d Mr Images

Segmentation of Cerebral Small Vessel Diseases-White Matter Hyperintensities Based on a Deep Learning System

U-net Combined with CRF and Anatomical Based Spatial Features to Segment White Matter Hyperintensities

Automatic Segmentation of White Matter Hyperintensities in Routine Clinical Brain MRI by 2D VB-Net: A Large-Scale Study

Specialized gray matter segmentation via a generative adversarial network: application on brain white matter hyperintensities classification

wmh_seg: Transformer based U-Net for Robust and Automatic White Matter Hyperintensity Segmentation across 1.5T, 3T and 7T

Brain hyperintensities: automatic segmentation of white matter hyperintensities in clinical brain MRI images using improved deep neural network

Hybrid Attention Densely Connected Ensemble Framework for Lesion Segmentation from Magnetic Resonance Images.

White Matter Hyperintensities Segmentation Using Fully Convolutional Network and Transfer Learning

End-to-end Volumetric Segmentation of White Matter Hyperintensities using Deep Learning

3D SA-UNet: 3D Spatial Attention UNet with 3D ASPP for White Matter Hyperintensities Segmentation

Multi-Scale Convolutional-Stack Aggregation for Robust White Matter Hyperintensities Segmentation

Multimodal Spatial-Based Segmentation Framework for White Matter Lesions in Multi-Sequence Magnetic Resonance Images

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation