Abstract:Automated methods for segmentation-based brain volumetry may be confounded by the presence of white matter (WM) lesions, which introduce abnormal intensities that can alter the classification of not only neighboring but also distant brain tissue. These lesions are common in pathologies where brain volumetry is also an important prognostic marker, such as in multiple sclerosis (MS), and thus reducing their effects is critical for improving volumetric accuracy and reliability. In this work, we analyze the effect of WM lesions on deep learning based brain tissue segmentation methods for brain volumetry and introduce techniques to reduce the error these lesions produce on the measured volumes. We propose a 3D patch-based deep learning framework for brain tissue segmentation which is trained on the outputs of a reference classical method. To deal more robustly with pathological cases having WM lesions, we use a combination of small patches and a percentile-based input normalization. To minimize the effect of WM lesions, we also propose a multi-task double U-Net architecture performing end-to-end inpainting and segmentation, along with a training data generation procedure. In the evaluation, we first analyze the error introduced by artificial WM lesions on our framework as well as in the reference segmentation method without the use of lesion inpainting techniques. To the best of our knowledge, this is the first analysis of WM lesion effect on a deep learning based tissue segmentation approach for brain volumetry. The proposed framework shows a significantly smaller and more localized error introduced by WM lesions than the reference segmentation method, that displays much larger global differences. We also evaluated the proposed lesion effect minimization technique by comparing the measured volumes before and after introducing artificial WM lesions to healthy images. The proposed approach performing end-to-end inpainting and segmentation effectively reduces the error introduced by small and large WM lesions in the resulting volumetry, obtaining absolute volume differences of 0.01 ± 0.03% for GM and 0.02 ± 0.04% for WM. Increasing the accuracy and reliability of automated brain volumetry methods will reduce the sample size needed to establish meaningful correlations in clinical studies and allow its use in individualized assessments as a diagnostic and prognostic marker for neurodegenerative pathologies.

Segmentation-Consistent Probabilistic Lesion Counting

P-Count: Persistence-based Counting of White Matter Hyperintensities in Brain MRI

Spatially Covariant Lesion Segmentation

Synchronous Image-Label Diffusion Probability Model with Application to Stroke Lesion Segmentation on Non-contrast CT

Modelling brain lesion volume in patches with CNN-based Poisson Regression

What is Healthy? Generative Counterfactual Diffusion for Lesion Localization

Volume Preserving Brain Lesion Segmentation.

Weakly Supervised Lesion Co-Segmentation on Ct Scans

Segmenting Small Stroke Lesions with Novel Labeling Strategies

A continuous learning approach to brain tumor segmentation: integrating multi-scale spatial distillation and pseudo-labeling strategies

Accurate Weakly-Supervised Deep Lesion Segmentation using Large-Scale Clinical Annotations: Slice-Propagated 3D Mask Generation from 2D RECIST

Minimizing the effect of white matter lesions on deep learning based tissue segmentation for brain volumetry

Learning to segment subcortical structures from noisy annotations with a novel uncertainty-reliability aware learning framework

SoftSeg: Advantages of soft versus binary training for image segmentation

Continuous lesion images drive more accurate predictions of outcomes after stroke than binary lesion images

Laplacian Segmentation Networks Improve Epistemic Uncertainty Quantification

SegHeD+: Segmentation of Heterogeneous Data for Multiple Sclerosis Lesions with Anatomical Constraints and Lesion-aware Augmentation

Lesion Segmentation in Ultrasound Using Semi-pixel-wise Cycle Generative Adversarial Nets

Automatic detection of lesion load change in Multiple Sclerosis using convolutional neural networks with segmentation confidence

Longitudinal Segmentation of MS Lesions via Temporal Difference Weighting

Meta-Analysis of Transfer Learning for Segmentation of Brain Lesions