Abstract:Background Market-applicable concurrent electrocardiogram (ECG) diagnosis for multiple heart abnormalities that covers a wide range of arrhythmias, with better-than-human accuracy, has not yet been developed. We therefore aimed to engineer a deep learning approach for the automated multilabel diagnosis of heart rhythm or conduction abnormalities by real-time ECG analysis. Methods We used a dataset of ECGs (standard 10 s, 12-channel format) from adult patients (aged >= 18 years), with 21 distinct rhythm classes, including most types of heart rhythm or conduction abnormalities, for the diagnosis of arrhythmias at multilabel level. The ECGs were collected from three campuses of Tongji Hospital (Huazhong University of Science and Technology, Wuhan, China) and annotated by cardiologists. We used these datasets to develop a convolutional neural network approach to generate diagnoses of arrythmias. We collected a test dataset of ECGs from a new group of patients not included in the training dataset. The test dataset was annotated by consensus of a committee of board-certified, actively practicing cardiologists. To evaluate the performance of the model we assessed the F1 score and the area under the curve (AUC) of the receiver operating characteristic (ROC) curve, as well as quantifying sensitivity and specificity. To validate our results, findings for the test dataset were compared with diagnoses made by 53 ECG physicians working in cardiology departments who had a wide range of experience in ECG interpretation (range 0 to >12 years). An external public validation dataset of 962 ECGs from other hospitals was used to study generalisability of the diagnostic model. Findings Our training and validation dataset comprised 180 112 ECGs from 70 692 patients, collected between Jan 1, 2012, and Apr 30, 2019. The test dataset comprised 828 ECGs corresponding to 828 new patients, recorded between Sept 11, 2012, and Aug 30, 2019. At the multilabel level, our deep learning approach to diagnosing heart abnormalities resulted in an exact match in 658 (80%) of 828 ECGs, exceeding the mean performance of physicians (552 [67%] for physicians with 0-6 years of experience; 571 [69%] for physicians with 7-12 years of experience; 621 [75%] for physicians with more than 12 years of experience). Our model had an overall mean F1 score of 0 center dot 887 compared with 0 center dot 789 for physicians with 0-6 years of experience, 0 center dot 815 for physicians with 7-12 years of experience, and 0 center dot 831 for physicians with more than 12 years of experience. The model had a mean AUC ROC score of 0 center dot 983 (95% CI 0 center dot 980-0 center dot 986), sensitivity of 0 center dot 867 (0 center dot 849-0 center dot 885) and specificity of 0 center dot 995 (0 center dot 994-0 center dot 996). Promising F1 scores were also obtained from the external public database using our proposed model without any model modifications (mean F1 scores of 0 center dot 845 in multilabel and 0 center dot 852 in single-label ECGs). Interpretation Our model is more accurate than physicians working in cardiology departments at distinguishing a range of distinct arrhythmias in single-label and multilabel ECGs, laying a promising foundation for computational decision-support systems in clinical applications. Copyright (c) 2020 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY-NC-ND 4.0 license.

Deep Learning with Weak Annotation from Diagnosis Reports for Detection of Multiple Head Disorders: a Prospective, Multicentre Study

Impact of ROIs Delineation Strategies on the Performance of Artificial Intelligence-Aided COVID-19 Screening Algorithms

Automatic Intracranial Abnormality Detection and Localization in Head CT Scans by Learning from Free-Text Reports.

An interpretable deep learning workflow for discovering subvisual abnormalities in CT scans of COVID-19 inpatients and survivors

A Deep-Learning Model for Intracranial Aneurysm Detection on CT Angiography Images in China: a Stepwise, Multicentre, Early-Stage Clinical Validation Study

Multi-label annotation of text reports from computed tomography of the chest, abdomen, and pelvis using deep learning

Effects of a comprehensive brain computed tomography deep learning model on radiologist detection accuracy

Disorder-Free Data are All You Need: Inverse Supervised Learning for Broad-Spectrum Head Disorder Detection

Evaluation of 'deep Learning System' (DLS) for Assistive Diagnosis of Brain Tumors Based on MR Image

Deep learning to automate the labelling of head MRI datasets for computer vision applications

Classification of Multiple Diseases on Body CT Scans using Weakly Supervised Deep Learning

Deep-Learning Tool for Early Identifying Non-Traumatic Intracranial Hemorrhage Etiology based on CT Scan

Development and validation of an abnormality-derived deep-learning diagnostic system for major respiratory diseases

Impact of a deep learning-based brain CT interpretation algorithm on clinical decision-making for intracranial hemorrhage in the emergency department

Deep learning models for triaging hospital head MRI examinations

Weakly Supervised Learning Significantly Reduces the Number of Labels Required for Intracranial Hemorrhage Detection on Head CT

Enhancing Radiologists' Performance in Detecting Cerebral Aneurysms Using a Deep Learning Model: A Multicenter Study

Artificial intelligence for stepwise diagnosis and monitoring of COVID-19

Automatic Multilabel Electrocardiogram Diagnosis of Heart Rhythm or Conduction Abnormalities with Deep Learning: a Cohort Study.

Clinically Applicable Deep Learning to Automate Pulmonary Scanning: Towards Building Intelligent CT Systems

A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis