Abstract:Background: Deep learning models have shown great success in automating tasks in sleep medicine by learning from carefully annotated electroencephalogram (EEG) data. However, effectively using a large amount of raw EEG data remains a challenge. Objective: In this study, we aim to learn robust vector representations from massive unlabeled EEG signals, such that the learned vectorized features (1) are expressive enough to replace the raw signals in the sleep staging task, and (2) provide better predictive performance than supervised models in scenarios involving fewer labels and noisy samples. Methods: We propose a self-supervised model, Contrast with the World Representation (ContraWR), for EEG signal representation learning. Unlike previous models that use a set of negative samples, our model uses global statistics (ie, the average representation) from the data set to distinguish signals associated with different sleep stages. The ContraWR model is evaluated on 3 real-world EEG data sets that include both settings: at-home and in-laboratory EEG recording. Results: ContraWR outperforms 4 recently reported self-supervised learning methods on the sleep staging task across 3 large EEG data sets. ContraWR also supersedes supervised learning when fewer training labels are available (eg, 4% accuracy improvement when less than 2% of data are labeled on the Sleep EDF data set). Moreover, the model provides informative, representative feature structures in 2D projection. Conclusions: We show that ContraWR is robust to noise and can provide high-quality EEG representations for downstream prediction tasks. The proposed model can be generalized to other unsupervised physiological signal learning tasks. Future directions include exploring task-specific data augmentations and combining self-supervised methods with supervised methods, building upon the initial success of self-supervised learning reported in this study.

Uncovering the structure of clinical EEG signals with self-supervised learning

Learning with self-supervision on EEG data

Self-supervised Learning for Electroencephalogram: A Systematic Survey

Self-supervised representation learning from electroencephalography signals

EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Model

Subject-based Non-contrastive Self-Supervised Learning for ECG Signal Processing

Anomaly Detection on Electroencephalography with Self-supervised Learning

Self-supervised Learning with Attention Mechanism for EEG-based seizure detection

Self-supervised Contrastive Learning for EEG-based Sleep Staging

ECGBERT: Understanding Hidden Language of ECGs with Self-Supervised Representation Learning

Joint Spatio-Temporal Features Constrained Self-Supervised Electrocardiogram Representation Learning

BENDR: Using Transformers and a Contrastive Self-Supervised Learning Task to Learn From Massive Amounts of EEG Data

CLECG: A Novel Contrastive Learning Framework for Electrocardiogram Arrhythmia Classification

Task-oriented Self-supervised Learning for Anomaly Detection in Electroencephalography

A semi-supervised deep learning algorithm for abnormal EEG identification

Unlocking Telemetry Potential: Self-Supervised Learning for Continuous Clinical Electrocardiogram Monitoring

Self-Supervised Electroencephalogram Representation Learning for Automatic Sleep Staging: Model Development and Evaluation Study

SPEED: Scalable Preprocessing of EEG Data for Self-Supervised Learning

Eeg2vec: Self-Supervised Electroencephalographic Representation Learning

Investigating Self-Supervised Deep Representations for EEG-based Auditory Attention Decoding

Self-supervised EEG Representation Learning for Automatic Sleep Staging