Abstract:Clinical 12-lead electrocardiography (ECG) is one of the most widely encountered kinds of biosignals. Despite the increased availability of public ECG datasets, label scarcity remains a central challenge in the field. Self-supervised learning represents a promising way to alleviate this issue. This would allow to train more powerful models given the same amount of labeled data and to incorporate or improve predictions about rare diseases, for which training datasets are inherently limited. In this work, we put forward the first comprehensive assessment of self-supervised representation learning from clinical 12-lead ECG data. To this end, we adapt state-of-the-art self-supervised methods based on instance discrimination and latent forecasting to the ECG domain. In a first step, we learn contrastive representations and evaluate their quality based on linear evaluation performance on a recently established, comprehensive, clinical ECG classification task. In a second step, we analyze the impact of self-supervised pretraining on finetuned ECG classifiers as compared to purely supervised performance. For the best-performing method, an adaptation of contrastive predictive coding, we find a linear evaluation performance only 0.5% below supervised performance. For the finetuned models, we find improvements in downstream performance of roughly 1% compared to supervised performance, label efficiency, as well as robustness against physiological noise. This work clearly establishes the feasibility of extracting discriminative representations from ECG data via self-supervised learning and the numerous advantages when finetuning such representations on downstream tasks as compared to purely supervised training. As first comprehensive assessment of its kind in the ECG domain carried out exclusively on publicly available datasets, we hope to establish a first step towards reproducible progress in the rapidly evolving field of representation learning for biosignals.

Self-supervised representation learning from electroencephalography signals

Learning with self-supervision on EEG data

Joint Spatio-Temporal Features Constrained Self-Supervised Electrocardiogram Representation Learning

Uncovering the structure of clinical EEG signals with self-supervised learning

Self-supervised representation learning from 12-lead ECG data

Self-Supervised Electroencephalogram Representation Learning for Automatic Sleep Staging: Model Development and Evaluation Study

Self-supervised EEG Representation Learning for Automatic Sleep Staging

Self-supervised Learning for Electroencephalogram: A Systematic Survey

Spatiotemporal self-supervised representation learning from multi-lead ECG signals

Eeg2vec: Self-Supervised Electroencephalographic Representation Learning

Self-Supervised Learning for Biomedical Signal Processing: A Systematic Review on ECG and PPG Signals

Anomaly Detection on Electroencephalography with Self-supervised Learning

Weak self-supervised learning for seizure forecasting: a feasibility study

EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputs

Self-Supervised Representation Learning for Sleep Stage Classification with Feature Space Augmentation and Temporal Prediction

Task-oriented Self-supervised Learning for Anomaly Detection in Electroencephalography

Self-Supervised Learning of Brain Dynamics from Broad Neuroimaging Data

Subject-based Non-contrastive Self-Supervised Learning for ECG Signal Processing

Self-Supervised PPG Representation Learning Shows High Inter-Subject Variability

EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Model

BENDR: Using Transformers and a Contrastive Self-Supervised Learning Task to Learn From Massive Amounts of EEG Data