Abstract:Background: Echocardiography is the diagnostic modality for assessing cardiac systolic and diastolic function to diagnose and manage heart failure. However, manual interpretation of echocardiograms can be time consuming and subject to human error. Therefore, we developed a fully automated deep learning workflow to classify, segment, and annotate two-dimensional (2D) videos and Doppler modalities in echocardiograms. Methods: We developed the workflow using a training dataset of 1145 echocardiograms and an internal test set of 406 echocardiograms from the prospective heart failure research platform (Asian Network for Translational Research and Cardiovascular Trials; ATTRaCT) in Asia, with previous manual tracings by expert sonographers. We validated the workflow against manual measurements in a curated dataset from Canada (Alberta Heart Failure Etiology and Analysis Research Team; HEART; n=1029 echocardiograms), a real-world dataset from Taiwan (n=31 241), the US-based EchoNet-Dynamic dataset (n=10 030), and in an independent prospective assessment of the Asian (ATTRaCT) and Canadian (Alberta HEART) datasets (n=142) with repeated independent measurements by two expert sonographers. Findings: In the ATTRaCT test set, the automated workflow classified 2D videos and Doppler modalities with accuracies (number of correct predictions divided by the total number of predictions) ranging from 0·91 to 0·99. Segmentations of the left ventricle and left atrium were accurate, with a mean Dice similarity coefficient greater than 93% for all. In the external datasets (n=1029 to 10 030 echocardiograms used as input), automated measurements showed good agreement with locally measured values, with a mean absolute error range of 9-25 mL for left ventricular volumes, 6-10% for left ventricular ejection fraction (LVEF), and 1·8-2·2 for the ratio of the mitral inflow E wave to the tissue Doppler e' wave (E/e' ratio); and reliably classified systolic dysfunction (LVEF <40%, area under the receiver operating characteristic curve [AUC] range 0·90-0·92) and diastolic dysfunction (E/e' ratio ≥13, AUC range 0·91-0·91), with narrow 95% CIs for AUC values. Independent prospective evaluation confirmed less variance of automated compared with human expert measurements, with all individual equivalence coefficients being less than 0 for all measurements. Interpretation: Deep learning algorithms can automatically annotate 2D videos and Doppler modalities with similar accuracy to manual measurements by expert sonographers. Use of an automated workflow might accelerate access, improve quality, and reduce costs in diagnosing and managing heart failure globally. Funding: A*STAR Biomedical Research Council and A*STAR Exploit Technologies.

Automatic Classification of Intracardiac Tumor and Thrombi in Echocardiography Based on Sparse Representation.

Patient-Specific ECG Classification with Integrated Long Short-Term Memory and Convolutional Neural Networks

Automated Heartbeat Classification Exploiting Convolutional Neural Network with Channel-Wise Attention

An Early Prediction of Tumor in Heart by Cardiac Masses Classification in Echocardiogram Images Using Robust Back Propagation Neural Network Classifier

Direct Delineation of Myocardial Infarction Without Contrast Agents Using a Joint Motion Feature Learning Architecture

Automated Heartbeat Classification Using 3-D Inputs Based on Convolutional Neural Network with Multi-Fields of View.

Detecting and Classifying Myocardial Infarction in Echocardiogram Frames With an Enhanced CNN Algorithm and ECV-3D Network

Fast and accurate classification of echocardiograms using deep learning

Automated chest screening based on a hybrid model of transfer learning and convolutional sparse denoising autoencoder

Automatic detection and classification of breast tumors in ultrasonic images using texture and morphological features.

Cardiac disease discrimination from 3D-convolutional kinematic patterns on cine-MRI sequences

Automated Recognition of Regional Wall Motion Abnormalities Through Deep Neural Network Interpretation of Transthoracic Echocardiography

A Computer Vision Pipeline for Automated Determination of Cardiac Structure and Function and Detection of Disease by Two-Dimensional Echocardiography

An Automated Heart Shunt Recognition Pipeline Using Deep Neural Networks

Visual recognition of cardiac pathology based on 3D parametric model reconstruction

A deep learning framework assisted echocardiography with diagnosis, lesion localization, phenogrouping heterogeneous disease, and anomaly detection

Spatially localized sparse approximations of deep features for breast mass characterization

A visually interpretable detection method combines 3-D ECG with a multi-VGG neural network for myocardial infarction identification

A Deep Learning Network for the Classification of Intracardiac Electrograms in Atrial Tachycardia

Automatic Endocardium Extraction for Echocardiogram

Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study