Abstract:Electrocardiogram (ECG) is a universal diagnostic tool for heart disease, which can provide data for deep learning. The scarcity of labeled data is a major challenge for medical artificial intelligence diagnosis. Acquiring labeled medical data is time-consuming and high-cost because medical specialists are needed. As a kind of generative self-supervised learning method, a masked autoencoder (MAE) is capable to solve these problems. MAE family of ECG (MaeFE) is proposed in this article. Considering the temporal and spatial features of ECG, MaeFE contains three customized masking modes, including masked time autoencoder (MTAE), masked lead autoencoder (MLAE), and masked lead and time autoencoder (MLTAE). MTAE and MLAE pay greater attention to temporal features and spatial features, respectively. MLTAE is a multihead architecture that combines MTAE and MLAE. In the pretraining stage, ECG signals from the pretrain dataset are divided into patches and partially masked. The encoder transfers unmasked patches to tokens and the decoder reconstructs masked ones. In downstream tasks, the pretrained encoder is utilized as a classifier, which is arrhythmia classification performed in the downstream dataset. The process is the so-called transfer learning. MaeFE outperforms the state-of-the-art self-supervised learning methods, SimCLR, MoCo, CLOCS, and MaskUNet in downstream tasks. MTAE has the best comprehensive performance. Compared to contrastive learning models, MTAE achieves at least a 5.18%, 11.80%, and 3.23% increase in accuracy (Acc), Macro-F-1, and area under the curve (AUC), respectively, using the linear probe. It also outperforms other models at 8.99% in Acc, 20.18% in Macro-F-1, and 7.13% in AUC using fine-tuning. As another downstream task, experiments on the multilabel classification of arrhythmia are also conducted, which reflects the excellent generalization performance of MaeFE. Depending on experimental results, MaeFE turns out to be efficient and robust in downstream tasks. Overcoming the scarcity of labeled data, MaeFE is better than other self-supervised learning methods and achieves satisfying performance. Consequently, the algorithm in this article is on track of playing a major role in practical applications.

Spatiotemporal self-supervised representation learning from multi-lead ECG signals

Joint Spatio-Temporal Features Constrained Self-Supervised Electrocardiogram Representation Learning

MaeFE: Masked Autoencoders Family of Electrocardiogram for Self-Supervised Pretraining and Transfer Learning.

Multi-label Classification of Abnormalities in 12-Lead ECG Using Deep Learning.

Self-supervised ECG pre-training

Self-supervised representation learning from 12-lead ECG data

Spatio-Temporal 3-Dimentional Variations Modeling with Self-Attention for Multi-Label ECG Classification

Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysis

Spatiotemporal 3-D Variations Modeling with Self-Attention for Multilabel ECG Classification

Wave masked Autoencoder: an electrocardiogram signal diagnosis model based on wave making strategy

Self-Supervised Pre-Training with Joint-Embedding Predictive Architecture Boosts ECG Classification Performance

Lead-agnostic Self-supervised Learning for Local and Global Representations of Electrocardiogram

MetaVA: Curriculum Meta-learning and Pre-fine-tuning of Deep Neural Networks for Detecting Ventricular Arrhythmias based on ECGs

Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogram

Bootstrap each lead's latent: A novel method for self-supervised learning of multilead electrocardiograms

Universal 12-Lead ECG Representation for Signal Denoising and Cardiovascular Disease Detection by Fusing Generative and Contrastive Learning

ECG-SL: Electrocardiogram(ECG) Segment Learning, a deep learning method for ECG signal

A Task-Generic High-Performance Unsupervised Pre-Training Framework for ECG

A Simple Self-Supervised ECG Representation Learning Method Via Manipulated Temporal-Spatial Reverse Detection.

Unlocking Telemetry Potential: Self-Supervised Learning for Continuous Clinical Electrocardiogram Monitoring

Interpretable Deep Learning for Automatic Diagnosis of 12-lead Electrocardiogram