Abstract:PURPOSE : To investigate if artificial intelligence can identify fetus intracranial structures in pregnancy week 11-14; to provide an automated method of standard and non-standard sagittal view classification in obstetric ultrasound examination METHOD AND MATERIALS We proposed a newly designed scheme based on deep learning (DL) – Fetus Framework to identify nine fetus intracranial structures: thalami, midbrain, palate, 4th ventricle, cisterna magna, nuchal translucency (NT), nasal tip, nasal skin, and nasal bone. Fetus Framework was trained and tested on a dataset of 1528 2D sagittal-view ultrasound images from 1519 females collected from Shenzhen People's Hospital. Results from Fetus Framework were further used for standard/non-standard (S-NS) plane classification, a key step for NT measurement and Down Syndrome assessment. S-NS classification was also tested with 156 images from the Longhua branch of Shenzhen People's Hospital. Sensitivity, specificity, and area under the curve (AUC) were evaluated for comparison among Fetus Framework, three classic DL models, and human experts with 1-, 3- and 5-year ultrasound training. Furthermore, 4 physicians with more than 5 years of experience conducted a reader study of diagnosing fetal malformation on a dataset of 316 standard images confirmed by the Fetus framework and another dataset of 316 standard images selected by physicians. Accuracy, sensitivity, specificity, precision, and F1-Score of physicians' diagnosis on both sets are compared. RESULTS : Nine intracranial structures identified by Fetus Framework in validation are all consistent with that of senior radiologists. For S-NS sagittal view identification, Fetus Framework achieved an AUC of 0.996 (95%CI: 0.987, 1.000) in internal test, at par with classic DL models. In external test, FF reaches an AUC of 0.974 (95%CI: 0.952, 0.995), while ResNet-50 arrives at AUC∼0.883, 95% CI 0.828–0.939, Xception AUC∼0.890, 95% CI 0.834–0.946, and DenseNet-121 AUC∼0.894, 95% CI 0.839–0.949. For the internal test set, the sensitivity and specificity of the proposed framework are (0.905, 1), while the first-, third-, and fifth-year clinicians are (0.619, 0.986), (0.690, 0.958), and (0.798, 0.986), respectively. For the external test set, the sensitivity and specificity of FF is (0.989, 0.797), and first-, third-, and fifth-year clinicians are (0.533, 0.875), (0.609, 0.844), and (0.663, 0.781), respectively.On the fetal malformation classification task, all physicians achieved higher accuracy and F1-Score on Fetus selected standard images with statistical significance (p<0.01). CONCLUSION : We proposed a new deep learning-based Fetus Framework for identifying key fetus intracranial structures. The framework was tested on data from two different medical centers. The results show consistency and improvement from classic models and human experts in standard and non-standard sagittal view classification during pregnancy week 11-13+6. CLINICAL RELEVANCE/APPLICATION : With further refinement in larger population, the proposed model can improve the efficiency and accuracy of early pregnancy test using ultrasound examination.

Towards a device-independent deep learning approach for the automated segmentation of sonographic fetal brain structures: a multi-center and multi-device validation

Automated 3D Fetal Brain Segmentation Using an Optimized Deep Learning Approach

Mapping Fetal Brain Development Based on Automated Segmentation and 4D Brain Atlasing

Leveraging Clinically Relevant Biometric Constraints To Supervise A Deep Learning Model For The Accurate Caliper Placement To Obtain Sonographic Measurements Of The Fetal Brain

Automatic deep learning-based pipeline for automatic delineation and measurement of fetal brain structures in routine mid-trimester ultrasound images

How much can AI see in early pregnancy: A multi-center study of fetus head characterization in week 10-14 in ultrasound using deep learning

Fetal biometric based abnormality detection during prenatal development using deep learning techniques

Automatic fetal brain extraction from 2D in utero fetal MRI slices using deep neural network

Deep Learning-Based Multiclass Brain Tissue Segmentation in Fetal MRIs

Computer-aided diagnosis for fetal brain ultrasound images using deep convolutional neural networks

Learning to segment fetal brain tissue from noisy annotations

Real-Time Automatic Fetal Brain Extraction in Fetal MRI by Deep Learning

Multiview and Multiclass Image Segmentation using Deep Learning in Fetal Echocardiography

Human-level Performance On Automatic Head Biometrics In Fetal Ultrasound Using Fully Convolutional Neural Networks

Application of Automatic Segmentation on Super-Resolution Reconstruction MR Images of the Abnormal Fetal Brain

A YOLOX-Based Deep Instance Segmentation Neural Network for Cardiac Anatomical Structures in Fetal Ultrasound Images

Semi-automatic segmentation of the fetal brain from magnetic resonance imaging

Automatic quality assessment for 2D fetal sonographic standard plane based on multi-task learning

Autonomous fetal morphology scan: deep learning + clustering merger - the second pair of eyes behind the doctor

Integration of a Deep Convolutional Neural Network With Adaptive Channel Weight Technique for Automated Identification of Standard Fetal Biometry Planes

Segmentation of four-chamber view images in fetal ultrasound exams using a novel deep learning model ensemble method