Abstract:PurposeCardiac boundary segmentation of echocardiographic images is important for cardiac function assessment and disease diagnosis. However, it is challenging to segment cardiac ventricles due to the low contrast‐to‐noise ratio and speckle noise of the echocardiographic images. Manual segmentation is subject to interobserver variability and is too slow for real‐time image‐guided interventions. We aim to develop a deep learning‐based method for automated multi‐structure segmentation of echocardiographic images.MethodsWe developed an anchor‐free mask convolutional neural network (CNN), termed Cardiac‐SegNet, which consists of three subnetworks, that is, a backbone, a fully convolutional one‐state object detector (FCOS) head, and a mask head. The backbone extracts multi‐level and multi‐scale features from endocardium image. The FOCS head utilizes these features to detect and label the region‐of‐interests (ROIs) of the segmentation targets. Unlike the traditional mask regional CNN (Mask R‐CNN) method, the FCOS head is anchor‐free and can model the spatial relationship of the targets. The mask head utilizes a spatial attention strategy, which allows the network to highlight salient features to perform segmentation on each detected ROI. For evaluation, we investigated 450 patient datasets by a five‐fold cross‐validation and a hold‐out test. The endocardium (LVEndo) and epicardium (LVEpi) of the left ventricle and left atrium (LA) were segmented and compared with manual contours using the Dice similarity coefficient (DSC), Hausdorff distance (HD), mean absolute distance (MAD), and center‐of‐mass distance (CMD).ResultsCompared to U‐Net and Mask R‐CNN, our method achieved higher segmentation accuracy and fewer erroneous speckles. When our method was evaluated on a separate hold‐out dataset at the end diastole (ED) and the end systole (ES) phases, the average DSC were 0.952 and 0.939 at ED and ES for the LVEndo, 0.965 and 0.959 at ED and ES for the LVEpi, and 0.924 and 0.926 at ED and ES for the LA. For patients with a typical image size of 549 × 788 pixels, the proposed method can perform the segmentation within 0.5 s.ConclusionWe proposed a fast and accurate method to segment echocardiographic images using an anchor‐free mask CNN.

Simultaneous Right Ventricle End-diastolic and End-systolic Frame Identification and Landmark Detection on Echocardiography

A Heatmap Regression Approach for Right Ventricle Anatomical Landmarks Localization on Echocardiography

A Deep Learning Based Approach for Automatic Cardiac Events Identification

Multibeat echocardiographic phase detection using deep neural networks

Recognizing End-Diastole and End-Systole Frames via Deep Temporal Regression Network.

A Periodic Frame Learning Approach for Accurate Landmark Localization in M-Mode Echocardiography

Simultaneous segmentation and motion recovery in 3d cardiac image analysis

Cardiac Phase Detection in Echocardiograms With Densely Gated Recurrent Neural Networks and Global Extrema Loss

Co-learning of appearance and shape for precise ejection fraction estimation from echocardiographic sequences

Echocardiographic Image Multi-Structure Segmentation Using Cardiac-SegNet.

MAEF-Net: Multi-attention Efficient Feature Fusion Network for Left Ventricular Segmentation and Quantitative Analysis in Two-Dimensional Echocardiography.

Multi-task Learning Framework for Echocardiography Segmentation

EchoEFNet: Multi-task deep learning network for automatic calculation of left ventricular ejection fraction in 2D echocardiography

The Study of Echocardiography of Left Ventricle Segmentation Combining Transformer and Convolutional Neural Networks

A Deep Learning Network for Right Ventricle Segmentation in Short-Axis MRI.

Automatic Identification of the End-Diastolic and End-Systolic Cardiac Frames from Invasive Coronary Angiography Videos

Semi-supervised learning improves the performance of cardiac event detection in echocardiography

MAEF-Net: Multi-Attention Efficient Feature Fusion Network for Deep Learning Segmentation

Fetal Cardiac Cycle Detection in Multi-Resource Echocardiograms Using Hybrid Classification Framework.

Direct Full Quantification of the Left Ventricle Via Multitask Regression and Classification

PV-LVNet: Direct Left Ventricle Multitype Indices Estimation from 2D Echocardiograms of Paired Apical Views with Deep Neural Networks.