Abstract:The synthetic learning approach presents several key features for segmenting newborn brain MRIs. In particular, it is more robust to variations in image contrast and quality than a classical UNet, which is critical in this period of active brain maturation. Ground truth is shown in red, predictions in green. Brain segmentation from neonatal MRI images is a very challenging task due to large changes in the shape of cerebral structures and variations in signal intensities reflecting the gestational process. In this context, there is a clear need for segmentation techniques that are robust to variations in image contrast and to the spatial configuration of anatomical structures. In this work, we evaluate the potential of synthetic learning, a contrast‐independent model trained using synthetic images generated from the ground truth labels of very few subjects. We base our experiments on the dataset released by the developmental Human Connectome Project, for which high‐quality images are available for more than 700 babies aged between 26 and 45 weeks postconception. First, we confirm the impressive performance of a standard UNet trained on a few volumes, but also confirm that such models learn intensity‐related features specific to the training domain. We then confirm the robustness of the synthetic learning approach to variations in image contrast. However, we observe a clear influence of the age of the baby on the predictions. We improve the performance of this model by enriching the synthetic training set with realistic motion artifacts and over‐segmentation of the white matter. Based on extensive visual assessment, we argue that the better performance of the model trained on real T2w data may be due to systematic errors in the ground truth. We propose an original experiment allowing us to show that learning from real data will reproduce any systematic bias affecting the training set, while synthetic models can avoid this limitation. Overall, our experiments confirm that synthetic learning is an effective solution for segmenting neonatal brain MRI. Our adapted synthetic learning approach combines key features that will be instrumental for large multisite studies and clinical applications.

SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retraining

Robust Segmentation of Brain MRI in the Wild with Hierarchical CNNs and no Retraining

Robust machine learning segmentation for large-scale analysis of heterogeneous clinical brain MRI datasets

MixFormer: a Mixed CNN-Transformer Backbone for Medical Image Segmentation

SynSeg-Net: Synthetic Segmentation Without Target Modality Ground Truth

Maximizing domain generalization in fetal brain tissue segmentation: the role of synthetic data generation, intensity clustering and real image fine-tuning

Deep learning-based brain segmentation model performance validation with clinical radiotherapy CT

Improving cross-domain brain tissue segmentation in fetal MRI with synthetic data

Syn_SegNet: A Joint Deep Neural Network for Ultrahigh-Field 7T MRI Synthesis and Hippocampal Subfield Segmentation in Routine 3T MRI.

Synthetic Data for Robust Stroke Segmentation

Comprehensive analysis of synthetic learning applied to neonatal brain MRI segmentation

Syn_SegNet: A Joint Deep Neural Network for Ultrahigh-Field 7 T MRI Synthesis and Hippocampal Subfield Segmentation in Routine 3 T MRI

SynthSR: A public AI tool to turn heterogeneous clinical brain scans into high-resolution T1-weighted images for 3D morphometry

Validation of SynthSeg segmentation performance on CT using paired MRI from radiotherapy patients

Improving segmentation reliability of multi-scanner brain images using a generative adversarial network

Improving the generalizability of convolutional neural network-based segmentation on CMR images

Shape-Consistent Generative Adversarial Networks for Multi-Modal Medical Segmentation Maps

Contrast Adaptive Tissue Classification by Alternating Segmentation and Synthesis

Multiscale segmentation- and error-guided iterative convolutional neural network for cerebral neuron segmentation in microscopic images

Diagnosis of AD Based on Smri Whole Brain Segmentation

DeepMRSeg: A convolutional deep neural network for anatomy and abnormality segmentation on MR images