Abstract:Electrocardiogram (ECG) is a universal diagnostic tool for heart disease, which can provide data for deep learning. The scarcity of labeled data is a major challenge for medical artificial intelligence diagnosis. Acquiring labeled medical data is time-consuming and high-cost because medical specialists are needed. As a kind of generative self-supervised learning method, a masked autoencoder (MAE) is capable to solve these problems. MAE family of ECG (MaeFE) is proposed in this article. Considering the temporal and spatial features of ECG, MaeFE contains three customized masking modes, including masked time autoencoder (MTAE), masked lead autoencoder (MLAE), and masked lead and time autoencoder (MLTAE). MTAE and MLAE pay greater attention to temporal features and spatial features, respectively. MLTAE is a multihead architecture that combines MTAE and MLAE. In the pretraining stage, ECG signals from the pretrain dataset are divided into patches and partially masked. The encoder transfers unmasked patches to tokens and the decoder reconstructs masked ones. In downstream tasks, the pretrained encoder is utilized as a classifier, which is arrhythmia classification performed in the downstream dataset. The process is the so-called transfer learning. MaeFE outperforms the state-of-the-art self-supervised learning methods, SimCLR, MoCo, CLOCS, and MaskUNet in downstream tasks. MTAE has the best comprehensive performance. Compared to contrastive learning models, MTAE achieves at least a 5.18%, 11.80%, and 3.23% increase in accuracy (Acc), Macro-F-1, and area under the curve (AUC), respectively, using the linear probe. It also outperforms other models at 8.99% in Acc, 20.18% in Macro-F-1, and 7.13% in AUC using fine-tuning. As another downstream task, experiments on the multilabel classification of arrhythmia are also conducted, which reflects the excellent generalization performance of MaeFE. Depending on experimental results, MaeFE turns out to be efficient and robust in downstream tasks. Overcoming the scarcity of labeled data, MaeFE is better than other self-supervised learning methods and achieves satisfying performance. Consequently, the algorithm in this article is on track of playing a major role in practical applications.

Masked Self-Supervised ECG Representation Learning Via Multiview Information Bottleneck

Masked Autoencoder for ECG Representation Learning

Joint Spatio-Temporal Features Constrained Self-Supervised Electrocardiogram Representation Learning

Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysis

Spatiotemporal self-supervised representation learning from multi-lead ECG signals

CLECG: A Novel Contrastive Learning Framework for Electrocardiogram Arrhythmia Classification

Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogram

ECG Signal Reconstruction Based on Facial Videos Via Combined Explicit and Implicit Supervision.

Wave masked Autoencoder: an electrocardiogram signal diagnosis model based on wave making strategy

A Multi-view Spectral-Spatial-Temporal Masked Autoencoder for Decoding Emotions with Self-supervised Learning

Enhancing Representation Learning of EEG Data with Masked Autoencoders

A Simple Self-Supervised ECG Representation Learning Method Via Manipulated Temporal-Spatial Reverse Detection.

Eeg2vec: Self-Supervised Electroencephalographic Representation Learning

Self-supervised representation learning from 12-lead ECG data

A Task-Generic High-Performance Unsupervised Pre-Training Framework for ECG

MaeFE: Masked Autoencoders Family of Electrocardiogram for Self-Supervised Pretraining and Transfer Learning.

Masked Modeling for Self-supervised Representation Learning on Vision and Beyond

Universal 12-Lead ECG Representation for Signal Denoising and Cardiovascular Disease Detection by Fusing Generative and Contrastive Learning

Self-supervised ECG pre-training

A Multi-View Multi-Scale Neural Network for Multi-Label ECG Classification

EDMAE: An Efficient Decoupled Masked Autoencoder for Standard View Identification in Pediatric Echocardiography