Abstract:Electrocardiogram (ECG) is a universal diagnostic tool for heart disease, which can provide data for deep learning. The scarcity of labeled data is a major challenge for medical artificial intelligence diagnosis. Acquiring labeled medical data is time-consuming and high-cost because medical specialists are needed. As a kind of generative self-supervised learning method, a masked autoencoder (MAE) is capable to solve these problems. MAE family of ECG (MaeFE) is proposed in this article. Considering the temporal and spatial features of ECG, MaeFE contains three customized masking modes, including masked time autoencoder (MTAE), masked lead autoencoder (MLAE), and masked lead and time autoencoder (MLTAE). MTAE and MLAE pay greater attention to temporal features and spatial features, respectively. MLTAE is a multihead architecture that combines MTAE and MLAE. In the pretraining stage, ECG signals from the pretrain dataset are divided into patches and partially masked. The encoder transfers unmasked patches to tokens and the decoder reconstructs masked ones. In downstream tasks, the pretrained encoder is utilized as a classifier, which is arrhythmia classification performed in the downstream dataset. The process is the so-called transfer learning. MaeFE outperforms the state-of-the-art self-supervised learning methods, SimCLR, MoCo, CLOCS, and MaskUNet in downstream tasks. MTAE has the best comprehensive performance. Compared to contrastive learning models, MTAE achieves at least a 5.18%, 11.80%, and 3.23% increase in accuracy (Acc), Macro-F-1, and area under the curve (AUC), respectively, using the linear probe. It also outperforms other models at 8.99% in Acc, 20.18% in Macro-F-1, and 7.13% in AUC using fine-tuning. As another downstream task, experiments on the multilabel classification of arrhythmia are also conducted, which reflects the excellent generalization performance of MaeFE. Depending on experimental results, MaeFE turns out to be efficient and robust in downstream tasks. Overcoming the scarcity of labeled data, MaeFE is better than other self-supervised learning methods and achieves satisfying performance. Consequently, the algorithm in this article is on track of playing a major role in practical applications.

Wave masked Autoencoder: an electrocardiogram signal diagnosis model based on wave making strategy

Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysis

Joint Spatio-Temporal Features Constrained Self-Supervised Electrocardiogram Representation Learning

MaeFE: Masked Autoencoders Family of Electrocardiogram for Self-Supervised Pretraining and Transfer Learning.

Multi-label Classification of Abnormalities in 12-Lead ECG Using Deep Learning.

Spatiotemporal self-supervised representation learning from multi-lead ECG signals

Masked Autoencoder for ECG Representation Learning

A Task-Generic High-Performance Unsupervised Pre-Training Framework for ECG

ECG Arrhythmia Detection Using Disease-specific Attention-based Deep Learning Model

A novel method of swin transformer with time-frequency characteristics for ECG-based arrhythmia detection

Masked Transformer for Electrocardiogram Classification

Arrhythmia Detection from Electrocardiogram Signal Data Based on Wavelet Transform and Deep Reinforcement Learning

ECG autoencoder based on low-rank attention

Automatic Diagnosis of ECG Disease Based on Intelligent Simulation Modeling.

Automatic Diagnosis with 12-Lead ECG Signals.

Practical intelligent diagnostic algorithm for wearable 12-lead ECG via self-supervised learning on large-scale dataset

Deep Learning-Based Data Augmentation and Model Fusion for Automatic Arrhythmia Identification and Classification Algorithms

Generalizable Beat-by-Beat Arrhythmia Detection by Using Weakly Supervised Deep Learning

Wavelet transform and deep learning-based obstructive sleep apnea detection from single-lead ECG signals

Enhancing Representation Learning of EEG Data with Masked Autoencoders

GMAEEG: A Self-Supervised Graph Masked Autoencoder for EEG Representation Learning