Abstract:Electrocardiogram (ECG) is a universal diagnostic tool for heart disease, which can provide data for deep learning. The scarcity of labeled data is a major challenge for medical artificial intelligence diagnosis. Acquiring labeled medical data is time-consuming and high-cost because medical specialists are needed. As a kind of generative self-supervised learning method, a masked autoencoder (MAE) is capable to solve these problems. MAE family of ECG (MaeFE) is proposed in this article. Considering the temporal and spatial features of ECG, MaeFE contains three customized masking modes, including masked time autoencoder (MTAE), masked lead autoencoder (MLAE), and masked lead and time autoencoder (MLTAE). MTAE and MLAE pay greater attention to temporal features and spatial features, respectively. MLTAE is a multihead architecture that combines MTAE and MLAE. In the pretraining stage, ECG signals from the pretrain dataset are divided into patches and partially masked. The encoder transfers unmasked patches to tokens and the decoder reconstructs masked ones. In downstream tasks, the pretrained encoder is utilized as a classifier, which is arrhythmia classification performed in the downstream dataset. The process is the so-called transfer learning. MaeFE outperforms the state-of-the-art self-supervised learning methods, SimCLR, MoCo, CLOCS, and MaskUNet in downstream tasks. MTAE has the best comprehensive performance. Compared to contrastive learning models, MTAE achieves at least a 5.18%, 11.80%, and 3.23% increase in accuracy (Acc), Macro-F-1, and area under the curve (AUC), respectively, using the linear probe. It also outperforms other models at 8.99% in Acc, 20.18% in Macro-F-1, and 7.13% in AUC using fine-tuning. As another downstream task, experiments on the multilabel classification of arrhythmia are also conducted, which reflects the excellent generalization performance of MaeFE. Depending on experimental results, MaeFE turns out to be efficient and robust in downstream tasks. Overcoming the scarcity of labeled data, MaeFE is better than other self-supervised learning methods and achieves satisfying performance. Consequently, the algorithm in this article is on track of playing a major role in practical applications.

Learning Representations for Multi-Lead Electrocardiograms from Morphology-Rhythm Contrast

Learning Representations for Multilead Electrocardiograms From Morphology-Rhythm Contrast

CLECG: A Novel Contrastive Learning Framework for Electrocardiogram Arrhythmia Classification

Dense Lead Contrast for Self-Supervised Representation Learning of Multilead Electrocardiograms

A joint cross-dimensional contrastive learning framework for 12-lead ECGs and its heterogeneous deployment on SoC

Patient contrastive learning: A performant, expressive, and practical approach to electrocardiogram modeling

Multimodal contrastive learning for diagnosing cardiovascular diseases from electrocardiography (ECG) signals and patient metadata

Joint Spatio-Temporal Features Constrained Self-Supervised Electrocardiogram Representation Learning

A Multi-Resolution Mutual Learning Network for Multi-Label ECG Classification

Multi-label Classification of Abnormalities in 12-Lead ECG Using Deep Learning.

C-MELT: Contrastive Enhanced Masked Auto-Encoders for ECG-Language Pre-Training

Cross-modal multiscale multi-instance learning for long-term ECG classification

Contrastive Learning on Multimodal Analysis of Electronic Health Records

Learning Discriminative Representations of Superimposed P waves With Weakly-Supervised Temporal Contrastive Learning

Online Co-Learning Strategy Based on Multi-Branch Multi-Scale Network for 12-Lead ECG Classification

MaeFE: Masked Autoencoders Family of Electrocardiogram for Self-Supervised Pretraining and Transfer Learning.

Multi-gate Mixture of Multi-view Graph Contrastive Learning on Electronic Health Record

sCL-ST: Supervised Contrastive Learning With Semantic Transformations for Multiple Lead ECG Arrhythmia Classification

Online Co-Learning Strategy Based on Multibranch Multiscale Network for 12-Lead ECG Classification

Universal 12-Lead ECG Representation for Signal Denoising and Cardiovascular Disease Detection by Fusing Generative and Contrastive Learning

Teach Multimodal LLMs to Comprehend Electrocardiographic Images