Abstract:Background and Objectives Reliable detection of white matter hyperintensities (WMH) is crucial for studying the impact of diffuse white-matter pathology on brain health and monitoring changes in WMH load over time. However, manual annotation of 3D high-dimensional neuroimages is laborious and can be prone to biases and errors in the annotation procedure. In this study, we evaluate the performance of deep learning (DL) segmentation tools and propose a novel volumetric segmentation model incorporating self-attention via a transformer-based architecture. Ultimately, we aim to evaluate diverse factors that influence WMH segmentation, aiming for a comprehensive analysis of the state-of-the-art algorithms in a broader context. Methods We trained state-of-the-art DL algorithms, and incorporated advanced attention mechanisms, using structural fluid-attenuated inversion recovery (FLAIR) image acquisitions. The anatomical MRI data utilized for model training was obtained from healthy individuals aged 62-70 years in the LIve active Successful Aging (LISA) project. Given the potential sparsity of lesion volume among healthy aging individuals, we explored the impact of incorporating a weighted loss function and ensemble models. To assess the generalizability of the studied DL models, we applied the trained algorithm to an independent subset of data sourced from the MICCAI WMH challenge (MWSC). Notably, this subset had vastly different acquisition parameters compared to the LISA dataset used for training. Results Consistently, DL approaches exhibited commendable segmentation performance, achieving the level of inter-rater agreement comparable to expert performance, ensuring superior quality segmentation outcomes. On the out of sample dataset, the ensemble models exhibited the most outstanding performance. Conclusions DL methods generally surpassed conventional approaches in our study. While all DL methods performed comparably, incorporating attention mechanisms could prove advantageous in future applications with a wider availability of training data. As expected, our experiments indicate that the use of ensemble-based models enables the superior generalization in out-of-distribution settings. We believe that introducing DL methods in the WHM annotation workflow in heathy aging cohorts is promising, not only for reducing the annotation time required, but also for eventually improving accuracy and robustness via incorporating the automatic segmentations in the evaluation procedure.

White Matter Hyperintensities Segmentation Using Fully Convolutional Network and Transfer Learning

White matter hyperintensity segmentation from T1 and FLAIR images using fully convolutional neural networks enhanced with residual connections

Fully Automatic White Matter Hyperintensity Segmentation Using U-net and Skip Connection.

Fully Convolutional Network Ensembles for White Matter Hyperintensities Segmentation in MR Images

Deeply Supervised Multi-Scale Fully Convolutional Networks for Segmentation of White Matter Hyperintensities

Deep convolutional neural network for accurate segmentation and quantification of white matter hyperintensities.

U-net Combined with CRF and Anatomical Based Spatial Features to Segment White Matter Hyperintensities

Automatic Method for White Matter Lesion Segmentation Based on T1-Fluid-Attenuated Inversion Recovery Images

Multimodality White Matter Tract Segmentation Using CNN.

Segmentation of Cerebral Small Vessel Diseases-White Matter Hyperintensities Based on a Deep Learning System

Specialized gray matter segmentation via a generative adversarial network: application on brain white matter hyperintensities classification

Brain MRI Segmentation using Fully Convolutional Network and Transfer Learning

wmh_seg: Transformer based U-Net for Robust and Automatic White Matter Hyperintensity Segmentation across 1.5T, 3T and 7T

Automatic white matter lesion segmentation using contrast enhanced FLAIR intensity and Markov Random Field

White matter hyperintensities segmentation using an ensemble of neural networks

End-to-end Volumetric Segmentation of White Matter Hyperintensities using Deep Learning

3D SA-UNet: 3D Spatial Attention UNet with 3D ASPP for White Matter Hyperintensities Segmentation

Automatic Segmentation of White Matter Hyperintensities in Routine Clinical Brain MRI by 2D VB-Net: A Large-Scale Study

A Label-fusion-aided Convolutional Neural Network for Isointense Infant Brain Tissue Segmentation

Brain hyperintensities: automatic segmentation of white matter hyperintensities in clinical brain MRI images using improved deep neural network

Whole brain segmentation with full volume neural network