Abstract:Background and objective: Electrocardiogram (ECG) is one of the most important diagnostic tools for cardiovascular diseases (CVDs). Recent studies show that deep learning models can be trained using labeled ECGs to achieve automatic detection of CVDs, assisting cardiologists in diagnosis. However, the deep learning models heavily rely on labels in training, while manual labeling is costly and time-consuming. This paper proposes a new self-supervised learning (SSL) method for multilead ECGs: bootstrap each lead's latent (BELL) to reduce the reliance and boost model performance in various tasks, especially when training data are insufficient. Method: BELL is a variant of the well-known bootstrap your own latent (BYOL). The BELL aims to learn prior knowledge from unlabeled ECGs by pretraining, benefitting downstream tasks. It leverages the characteristics of multilead ECGs. First, BELL uses the multiple-branch skeleton, which is more effective in processing multilead ECGs. Moreover, it proposes intra-lead and inter-lead mean square error (MSE) to guide pretraining, and their fusion can result in better performances. Additionally, BELL inherits the main advantage of the BYOL: No negative pair is used in pretraining, making it more efficient. Results: In most cases, BELL surpasses previous works in the experiments. More importantly, the pretraining improves model performances by 0.69% ∼ 8.89% in downstream tasks when only 10% of training data are available. Furthermore, BELL shows excellent adaptability to uncurated ECG data from a real-world hospital. Only slight performance degradation occurs (<1% in most cases) when using these data. Conclusion: The results suggest that the BELL can alleviate the reliance on manual ECG labels from cardiologists, a critical bottleneck of the current deep learning-based models. In this way, the BELL can also help deep learning extend its application on automatic ECG analysis, reducing the cardiologists' burden in real-world diagnosis.

Spatiotemporal self-supervised representation learning from multi-lead ECG signals

Joint Spatio-Temporal Features Constrained Self-Supervised Electrocardiogram Representation Learning

Multi-label Classification of Abnormalities in 12-Lead ECG Using Deep Learning.

Self-supervised ECG pre-training

Self-supervised representation learning from 12-lead ECG data

Spatio-Temporal 3-Dimentional Variations Modeling with Self-Attention for Multi-Label ECG Classification

Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysis

Spatiotemporal 3-D Variations Modeling with Self-Attention for Multilabel ECG Classification

Wave masked Autoencoder: an electrocardiogram signal diagnosis model based on wave making strategy

Self-Supervised Pre-Training with Joint-Embedding Predictive Architecture Boosts ECG Classification Performance

Lead-agnostic Self-supervised Learning for Local and Global Representations of Electrocardiogram

MetaVA: Curriculum Meta-learning and Pre-fine-tuning of Deep Neural Networks for Detecting Ventricular Arrhythmias based on ECGs

Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogram

Bootstrap each lead's latent: A novel method for self-supervised learning of multilead electrocardiograms

ECG-SL: Electrocardiogram(ECG) Segment Learning, a deep learning method for ECG signal

CLECG: A Novel Contrastive Learning Framework for Electrocardiogram Arrhythmia Classification

A Task-Generic High-Performance Unsupervised Pre-Training Framework for ECG

A Simple Self-Supervised ECG Representation Learning Method Via Manipulated Temporal-Spatial Reverse Detection.

Unlocking Telemetry Potential: Self-Supervised Learning for Continuous Clinical Electrocardiogram Monitoring

Interpretable Deep Learning for Automatic Diagnosis of 12-lead Electrocardiogram

ECGBERT: Understanding Hidden Language of ECGs with Self-Supervised Representation Learning