Abstract:PurposeCardiac boundary segmentation of echocardiographic images is important for cardiac function assessment and disease diagnosis. However, it is challenging to segment cardiac ventricles due to the low contrast‐to‐noise ratio and speckle noise of the echocardiographic images. Manual segmentation is subject to interobserver variability and is too slow for real‐time image‐guided interventions. We aim to develop a deep learning‐based method for automated multi‐structure segmentation of echocardiographic images.MethodsWe developed an anchor‐free mask convolutional neural network (CNN), termed Cardiac‐SegNet, which consists of three subnetworks, that is, a backbone, a fully convolutional one‐state object detector (FCOS) head, and a mask head. The backbone extracts multi‐level and multi‐scale features from endocardium image. The FOCS head utilizes these features to detect and label the region‐of‐interests (ROIs) of the segmentation targets. Unlike the traditional mask regional CNN (Mask R‐CNN) method, the FCOS head is anchor‐free and can model the spatial relationship of the targets. The mask head utilizes a spatial attention strategy, which allows the network to highlight salient features to perform segmentation on each detected ROI. For evaluation, we investigated 450 patient datasets by a five‐fold cross‐validation and a hold‐out test. The endocardium (LVEndo) and epicardium (LVEpi) of the left ventricle and left atrium (LA) were segmented and compared with manual contours using the Dice similarity coefficient (DSC), Hausdorff distance (HD), mean absolute distance (MAD), and center‐of‐mass distance (CMD).ResultsCompared to U‐Net and Mask R‐CNN, our method achieved higher segmentation accuracy and fewer erroneous speckles. When our method was evaluated on a separate hold‐out dataset at the end diastole (ED) and the end systole (ES) phases, the average DSC were 0.952 and 0.939 at ED and ES for the LVEndo, 0.965 and 0.959 at ED and ES for the LVEpi, and 0.924 and 0.926 at ED and ES for the LA. For patients with a typical image size of 549 × 788 pixels, the proposed method can perform the segmentation within 0.5 s.ConclusionWe proposed a fast and accurate method to segment echocardiographic images using an anchor‐free mask CNN.

Multi-task Learning Framework for Echocardiography Segmentation

Echocardiographic Image Multi-Structure Segmentation Using Cardiac-SegNet.

A Multi-Task Network For Cardiac Magnetic Resonance Image Segmentation And Classification

An 8-Layer Residual U-Net with Deep Supervision for Segmentation of the Left Ventricle in Cardiac CT Angiography

A Multi-Scope Convolutional Neural Network for Automatic Left Ventricle Segmentation from Magnetic Resonance Images: Deep-Learning at Multiple Scopes.

The Study of Echocardiography of Left Ventricle Segmentation Combining Transformer and Convolutional Neural Networks

Multi-network approach for image segmentation in non-contrast enhanced cardiac 3D MRI of arrhythmic patients

Multi-task Learning for Motion Analysis and Segmentation in 3D Echocardiography

A Multi-Scale Network with the Encoder-Decoder Structure for CMR Segmentation

Fully Automated Machine Learning Pipeline for Echocardiogram Segmentation

Multi-Planar Deep Segmentation Networks for Cardiac Substructures from MRI and CT

A cascaded framework with cross-modality transfer learning for whole heart segmentation

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

An improved contrastive learning network for semi-supervised multi-structure segmentation in echocardiography

Deep U-Net architecture with curriculum learning for myocardial pathology segmentation in multi-sequence cardiac magnetic resonance images

Simultaneous Right Ventricle End-diastolic and End-systolic Frame Identification and Landmark Detection on Echocardiography

Full left ventricle quantification via deep multitask relationships learning

Fully automated deep learning based segmentation of normal, infarcted and edema regions from multiple cardiac MRI sequences

EchoONE: Segmenting Multiple echocardiography Planes in One Model

Multi-Source and Multi-Sequence Myocardial Pathology Segmentation Using a Cascading Refinement CNN

A Two-Stage Fully Automatic Segmentation Scheme Using Both 2D and 3D U-Net for Multi-sequence Cardiac MR.