Abstract:The synthetic learning approach presents several key features for segmenting newborn brain MRIs. In particular, it is more robust to variations in image contrast and quality than a classical UNet, which is critical in this period of active brain maturation. Ground truth is shown in red, predictions in green. Brain segmentation from neonatal MRI images is a very challenging task due to large changes in the shape of cerebral structures and variations in signal intensities reflecting the gestational process. In this context, there is a clear need for segmentation techniques that are robust to variations in image contrast and to the spatial configuration of anatomical structures. In this work, we evaluate the potential of synthetic learning, a contrast‐independent model trained using synthetic images generated from the ground truth labels of very few subjects. We base our experiments on the dataset released by the developmental Human Connectome Project, for which high‐quality images are available for more than 700 babies aged between 26 and 45 weeks postconception. First, we confirm the impressive performance of a standard UNet trained on a few volumes, but also confirm that such models learn intensity‐related features specific to the training domain. We then confirm the robustness of the synthetic learning approach to variations in image contrast. However, we observe a clear influence of the age of the baby on the predictions. We improve the performance of this model by enriching the synthetic training set with realistic motion artifacts and over‐segmentation of the white matter. Based on extensive visual assessment, we argue that the better performance of the model trained on real T2w data may be due to systematic errors in the ground truth. We propose an original experiment allowing us to show that learning from real data will reproduce any systematic bias affecting the training set, while synthetic models can avoid this limitation. Overall, our experiments confirm that synthetic learning is an effective solution for segmenting neonatal brain MRI. Our adapted synthetic learning approach combines key features that will be instrumental for large multisite studies and clinical applications.

Maximizing domain generalization in fetal brain tissue segmentation: the role of synthetic data generation, intensity clustering and real image fine-tuning

Improving cross-domain brain tissue segmentation in fetal MRI with synthetic data

Automated 3D Fetal Brain Segmentation Using an Optimized Deep Learning Approach

SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retraining

Domain generalization in fetal brain MRI segmentation \\with multi-reconstruction augmentation

Synthetic magnetic resonance images for domain adaptation: Application to fetal brain tissue segmentation

Robust Segmentation of Brain MRI in the Wild with Hierarchical CNNs and no Retraining

Harmonized Segmentation of Neonatal Brain MRI

Comprehensive analysis of synthetic learning applied to neonatal brain MRI segmentation

Robust machine learning segmentation for large-scale analysis of heterogeneous clinical brain MRI datasets

Synthesis of realistic fetal MRI with conditional Generative Adversarial Networks

Two-stage Generative Models of Simulating Training Data at the Voxel Level for Large-Scale Microscopy Bioimage Segmentation

Tissue Segmentation of Thick-Slice Fetal Brain MR Scans with Guidance from High-Quality Isotropic Volumes

Learning to Segment Brain Anatomy from 2D Ultrasound with Less Data

SynSeg-Net: Synthetic Segmentation Without Target Modality Ground Truth

Multi-Site Infant Brain Segmentation Algorithms: The iSeg-2019 Challenge

Application of Automatic Segmentation on Super-Resolution Reconstruction MR Images of the Abnormal Fetal Brain

Medical Image Segmentation via Single-Source Domain Generalization with Random Amplitude Spectrum Synthesis

Deep learning-based brain segmentation model performance validation with clinical radiotherapy CT

Generating multi-pathological and multi-modal images and labels for brain MRI

Causality-Inspired Single-Source Domain Generalization for Medical Image Segmentation