Abstract:Fetal congenital heart disease (FCHD) is a common, serious birth defect affecting ∼1% of newborns annually. Fetal echocardiography is the most effective and important technique for prenatal FCHD diagnosis. The prerequisites for accurate ultrasound FCHD diagnosis are accurate view recognition and high-quality diagnostic view extraction. However, these manual clinical procedures have drawbacks such as, varying technical capabilities and inefficiency. Therefore, the automatic identification of high-quality multiview fetal heart scan images is highly desirable to improve prenatal diagnosis efficiency and accuracy of FCHD. Here, we present a framework for multiview fetal heart ultrasound image recognition and quality assessment that comprises two parts: a multiview classification and localization network (MCLN) and an improved contrastive learning network (ICLN). In the MCLN, a multihead enhanced self-attention mechanism is applied to construct the classification network and identify six accurate and interpretable views of the fetal heart. In the ICLN, anatomical structure standardization and image clarity are considered. With contrastive learning, the absolute loss, feature relative loss and predicted value relative loss are combined to achieve favorable quality assessment results. Experiments show that the MCLN outperforms other state-of-the-art networks by 1.52-13.61% when determining the F1 score in six standard view recognition tasks, and the ICLN is comparable to the performance of expert cardiologists in the quality assessment of fetal heart ultrasound images, reaching 97% on a test set within 2 points for the four-chamber view task. Thus, our architecture offers great potential in helping cardiologists improve quality control for fetal echocardiographic images in clinical practice.

Improved Multi-Head Self-Attention Classification Network for Multi-View Fetal Echocardiography Recognition

Improving the Quality of Fetal Heart Ultrasound Imaging with Multihead Enhanced Self-Attention and Contrastive Learning

Fetal cardiac ultrasound standard section detection model based on multitask learning and mixed attention mechanism

Simultaneous Segmentation of Fetal Hearts and Lungs for Medical Ultrasound Images Via an Efficient Multi-scale Model Integrated with Attention Mechanism

Automatic quality assessment for 2D fetal sonographic standard plane based on multi-task learning

Multiview and Multiclass Image Segmentation using Deep Learning in Fetal Echocardiography

FHUSP-NET: A Multi-task model for fetal heart ultrasound standard plane recognition and key anatomical structures detection

Fetal heart ultrasound image-oriented adaptive classification deep model based on differentiable architecture search

Automatic Detection of Cardiac Chambers Using an Attention-based YOLOv4 Framework from Four-chamber View of Fetal Echocardiography

HFSCCD: A Hybrid Neural Network for Fetal Standard Cardiac Cycle Detection in Ultrasound Videos

Automated Heartbeat Classification Using 3-D Inputs Based on Convolutional Neural Network with Multi-Fields of View.

Segmentation of four-chamber view images in fetal ultrasound exams using a novel deep learning model ensemble method

Quality Assessment of Fetal Head Ultrasound Images Based on Faster R-CNN

SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound

Automatic Recognition of Fetal Heart Standard Section Based on Fast-RCNN

A category attention instance segmentation network for four cardiac chambers segmentation in fetal echocardiography

Multi-scale Multi-hierarchy Attention Convolutional Neural Network for Fetal Brain Extraction

Automated interpretation of congenital heart disease from multi-view echocardiograms

Human-level Performance On Automatic Head Biometrics In Fetal Ultrasound Using Fully Convolutional Neural Networks

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

FetalNet: Multi-task Deep Learning Framework for Fetal Ultrasound Biometric Measurements