Abstract:Automated interpretation of echocardiography by deep neural networks could support clinical reporting and improve efficiency. Whereas previous studies have evaluated spatial relationships using still frame images, we aimed to train and test a deep neural network for video analysis by combining spatial and temporal information, to automate the recognition of left ventricular regional wall motion abnormalities. We collected a series of transthoracic echocardiography examinations performed between July 2017 and April 2018 in 2 tertiary care hospitals. Regional wall abnormalities were defined by experienced physiologists and confirmed by trained cardiologists. First, we developed a 3-dimensional convolutional neural network model for view selection ensuring stringent image quality control. Second, a U-net model segmented images to annotate the location of each left ventricular wall. Third, a final 3-dimensional convolutional neural network model evaluated echocardiographic videos from 4 standard views, before and after segmentation, and calculated a wall motion abnormality confidence level (0–1) for each segment. To evaluate model stability, we performed 5-fold cross-validation and external validation. In a series of 10 638 echocardiograms, our view selection model identified 6454 (61%) examinations with sufficient image quality in all standard views. In this training set, 2740 frames were annotated to develop the segmentation model, which achieved a Dice similarity coefficient of 0.756. External validation was performed in 1756 examinations from an independent hospital. A regional wall motion abnormality was observed in 8.9% and 4.9% in the training and external validation datasets, respectively. The final model recognized regional wall motion abnormalities in the cross-validation and external validation datasets with an area under the receiver operating characteristic curve of 0.912 (95% CI, 0.896–0.928) and 0.891 (95% CI, 0.834–0.948), respectively. In the external validation dataset, the sensitivity was 81.8% (95% CI, 73.8%–88.2%), and specificity was 81.6% (95% CI, 80.4%–82.8%). In echocardiographic examinations of sufficient image quality, it is feasible for deep neural networks to automate the recognition of regional wall motion abnormalities using temporal and spatial information from moving images. Further investigation is required to optimize model performance and evaluate clinical applications.

Ultrasound Doppler Tissue Image Analysis Based on Neural Network

A New Quantitative Analyzing Method for Doppler Tissue Image Sequences

Quantitative Endoscopic Photoacoustic Tomography Using a Convolutional Neural Network.

Application of Doppler Tissue Imaging in Diagnosis of Fetal Arrhythmias

Automated multi-beat tissue Doppler echocardiography analysis using deep neural networks

A Unified Approach for Comprehensive Analysis of Various Spectral and Tissue Doppler Echocardiography

Quantitative Analysis of Sinoatrial Node Using Doppler Tissue Images.

Automated Heartbeat Classification Using 3-D Inputs Based on Convolutional Neural Network with Multi-Fields of View.

Lnista-Net: Learning Nonlocal Regularized Iterative Shrinkage-Thresholding Network for Noninvasive Cardiac Transmembrane Potential Imaging.

Automated Heartbeat Classification Exploiting Convolutional Neural Network with Channel-Wise Attention

Fully Automated Mitral Inflow Doppler Analysis Using Deep Learning

TAN: Temporal Affine Network for Real-Time Left Ventricle Anatomical Structure Analysis Based on 2D Ultrasound Videos

Dynamic three-dimensional reconstruction of tissue Doppler ultrasound heart images]

Investigation of in Vivo Human Cardiac Diffusion Tensor Imaging Using Unsupervised Dense Encoder-Fusion-Decoder Network

Accelerated cardiac diffusion tensor imaging using deep neural network

Automated Recognition of Regional Wall Motion Abnormalities Through Deep Neural Network Interpretation of Transthoracic Echocardiography

Comparative analysis of active contour and convolutional neural network in rapid left-ventricle volume quantification using echocardiographic imaging

Automated segmentation of biventricular contours in tissue phase mapping using deep learning

Vector Interpolation Method in Three-dimensional Reconstruction of Tissue Doppler Echocardiography.

Experimental Studies on Quantitative Assessment of Myocardial Infarction by Color Doppler Tissue Imaging

Deep learning-based image segmentation model using an MRI-based convolutional neural network for physiological evaluation of the heart