Abstract:Background: Echocardiography is the diagnostic modality for assessing cardiac systolic and diastolic function to diagnose and manage heart failure. However, manual interpretation of echocardiograms can be time consuming and subject to human error. Therefore, we developed a fully automated deep learning workflow to classify, segment, and annotate two-dimensional (2D) videos and Doppler modalities in echocardiograms. Methods: We developed the workflow using a training dataset of 1145 echocardiograms and an internal test set of 406 echocardiograms from the prospective heart failure research platform (Asian Network for Translational Research and Cardiovascular Trials; ATTRaCT) in Asia, with previous manual tracings by expert sonographers. We validated the workflow against manual measurements in a curated dataset from Canada (Alberta Heart Failure Etiology and Analysis Research Team; HEART; n=1029 echocardiograms), a real-world dataset from Taiwan (n=31 241), the US-based EchoNet-Dynamic dataset (n=10 030), and in an independent prospective assessment of the Asian (ATTRaCT) and Canadian (Alberta HEART) datasets (n=142) with repeated independent measurements by two expert sonographers. Findings: In the ATTRaCT test set, the automated workflow classified 2D videos and Doppler modalities with accuracies (number of correct predictions divided by the total number of predictions) ranging from 0·91 to 0·99. Segmentations of the left ventricle and left atrium were accurate, with a mean Dice similarity coefficient greater than 93% for all. In the external datasets (n=1029 to 10 030 echocardiograms used as input), automated measurements showed good agreement with locally measured values, with a mean absolute error range of 9-25 mL for left ventricular volumes, 6-10% for left ventricular ejection fraction (LVEF), and 1·8-2·2 for the ratio of the mitral inflow E wave to the tissue Doppler e' wave (E/e' ratio); and reliably classified systolic dysfunction (LVEF <40%, area under the receiver operating characteristic curve [AUC] range 0·90-0·92) and diastolic dysfunction (E/e' ratio ≥13, AUC range 0·91-0·91), with narrow 95% CIs for AUC values. Independent prospective evaluation confirmed less variance of automated compared with human expert measurements, with all individual equivalence coefficients being less than 0 for all measurements. Interpretation: Deep learning algorithms can automatically annotate 2D videos and Doppler modalities with similar accuracy to manual measurements by expert sonographers. Use of an automated workflow might accelerate access, improve quality, and reduce costs in diagnosing and managing heart failure globally. Funding: A*STAR Biomedical Research Council and A*STAR Exploit Technologies.

Automated 2-D and 3-D Left Atrial Volume Measurements Using Deep Learning

Two-Dimensional Tissue Tracking: A Novel Echocardiographic Technique To Measure Left Atrial Volume: Comparison With Biplane Area Length Method And Real Time Three-Dimensional Echocardiography

Automated Assessment of Right Atrial Pressure From Ultrasound Videos Using Machine Learning

CardiacField: Computational Echocardiography for Automated Heart Function Estimation Using Two-Dimensional Echocardiography Probes

Automated Segmentation and Quantification of the Right Ventricle in 2-D Echocardiography

Deep Learning-Based Automated Left Ventricular Ejection Fraction Assessment Using 2-D Echocardiography

Automated left atrial time-resolved segmentation in MRI long-axis cine images using active contours

Fully Automated Mitral Inflow Doppler Analysis Using Deep Learning

Automated estimation of mitral annular plane systolic excursion by artificial intelligence from 3D ultrasound recordings

Concordance of left ventricular volumes and function measurements between two human readers, a fully automated AI algorithm, and the 3D heart model

Left Atrial Ejection Fraction Estimation Using SEGANet for Fully Automated Segmentation of CINE MRI

Speeding up echocardiographic examination by automated generation of 2D imaging views from 3D volumetric data using machine learning

A Two-stage Method with a Shared 3D U-Net for Left Atrial Segmentation of Late Gadolinium-Enhanced MRI Images

Abstract 15312: Automatic Left Atrial Volume and Sphericity Index Calculation From Cardiac CT Using Computer Graphics Imaging and Deep Learning

Machine learning algorithm using publicly available echo database for simplified “visual estimation” of left ventricular ejection fraction

Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study

Automatic Measurements of Fetal Lateral Ventricles in 2D Ultrasound Images Using Deep Learning.

High-resolution 3D Maps of Left Atrial Displacements using an Unsupervised Image Registration Neural Network

Image-based estimation of the left ventricular cavity volume using deep learning and Gaussian process with cardio-mechanical applications

Automatic Left Ventricle Volume and Mass quantification from 2D Cine-MRI: Investigating Papillary Muscle Influence

Left Atrial Volume as a Biomarker of Atrial Fibrillation at Routine Chest CT: Deep Learning Approach