Abstract:Congenital heart defects (CHD) result in high morbidity and mortality rates, but their origins are poorly understood. Mouse models of heart morphogenesis are required to study the pathological mechanisms of heart development compared to normal. In mouse fetuses, CHD can be observed and detected in 3D images obtained by thoracic micro-computed tomography (μCT). However, diagnosis of CHD from μCT scans is a time-consuming process that requires the experience of senior experts. An automated alternative would thus save time, empower less experienced investigators and could broaden analysis to larger numbers of samples. Here, we describe and validate an approach based on deep learning to automatically segment the heart and screen normal from malformed hearts in mouse μCT scans. In an initial cohort, we collected 139 μCT scans from thorax and abdomen of control and mutant perinatal mice. We trained a self-configurating neural network (nnU-Net) to segment hearts from body μCT scans and validated its performance on expert segmentations, achieving a Dice coefficient of 96%. To identify malformed hearts, we developed and trained a 3D convolutional neural network (CNN) that uses segmented μCT scans as inputs. Despite the relatively small training data size, our diagnosis model achieved a sensitivity, specificity (for a 0.5 threshold), and area under the curve (AUC) of 92%, 96%, and 97% respectively, as determined by 5-fold cross-validation. As further validation, we analyzed two additional cohorts that were collected after the model was trained: a ‘prospective’ cohort, using the same experimental protocol as the initial cohort, and containing a subset of its genotypes, and a ‘divergent’ cohort in which mice were subjected to a different treatment for heart arrest (cardioplegia) and that contained a new mouse line. Performance on the prospective cohort was excellent, with a sensitivity of 92%, a specificity of 100%, and an AUC of 100%. Performance on the divergent cohort was moderate (sensitivity: 69%, specificity: 80% and AUC: 81%), but was much improved when the model was finetuned on (a subset of) the cohort (sensitivity: 79%, specificity: 88% and AUC: 91%). These results showcase our model’s robustness and adaptability to technical and biological differences in the data, highlighting its usefulness for practical applications. In order to facilitate the adoption, adaptation and further improvement of these methods, we built a user-friendly (available at ) that allows users without programming skills to utilize the segmentation and diagnosis models and re-train the latter on their own data and resources. The plugin also highlights the cardiac regions used for the diagnosis. Our automatic and retrainable pipeline, which can be employed in high-throughput genetic screening, will accelerate diagnosis of heart anomalies in mice and facilitate studies of the mechanisms of CHD.

A computational framework for the detection of subcortical brain dysmaturation in neonatal MRI using 3D Convolutional Neural Networks

Automated 3D Fetal Brain Segmentation Using an Optimized Deep Learning Approach

Neurodevelopmental Age Estimation of Infants Using a 3D-Convolutional Neural Network Model based on Fusion MRI Sequences

Joint Prediction of Longitudinal Development of Cortical Surfaces and White Matter Fibers from Neonatal MRI

A Hybrid Multishape Learning Framework for Longitudinal Prediction of Cortical Surfaces and Fiber Tracts Using Neonatal Data

Automated detection of critical findings in multi-parametric brain MRI using a system of 3D neural networks

Deep Learning to Predict Neonatal and Infant Brain Age from Myelination on Brain MRI Scans

Infant brain age classification: 2D CNN outperforms 3D CNN in small dataset

Distributionally Robust Segmentation of Abnormal Fetal Brain 3D MRI

Deep Learning Mixture-of-Experts Approach for Cytotoxic Edema Assessment in Infants and Children

Can deep learning classify cerebral ultrasound images for the detection of brain injury in very preterm infants?

The Challenge of Cerebral Magnetic Resonance Imaging in Neonates: A New Method Using Mathematical Morphology for the Segmentation of Structures Including Diffuse Excessive High Signal Intensities.

Objective and Automated Detection of Diffuse White Matter Abnormality in Preterm Infants Using Deep Convolutional Neural Networks.

Computer-aided diagnosis for fetal brain ultrasound images using deep convolutional neural networks

Deep learning-based detection of murine congenital heart defects from µCT scans

Deep learning microstructure estimation of developing brains from diffusion MRI: A newborn and fetal study

Graphic Intelligent Diagnosis of Hypoxic-Ischemic Encephalopathy Using MRI-Based Deep Learning Model

Automatic linear measurements of the fetal brain on MRI with deep neural networks

Automatic Segmentation and Location Learning of Neonatal Cerebral Ventricles in 3D Ultrasound Data Combining CNN and CPPN

A Deep Spatial Context Guided Framework for Infant Brain Subcortical Segmentation.

Automated MRI Lung Segmentation and 3D Morphologic Features for Quantification of Neonatal Lung Disease