Abstract:The multi-lead electrocardiogram (ECG) is widely utilized in clinical diagnosis and monitoring of cardiac conditions. The advancement of deep learning has led to the emergence of automated multi-lead ECG diagnostic networks, which have become essential in the fields of biomedical engineering and clinical cardiac disease diagnosis. Intelligent ECG diagnosis techniques encompass Recurrent Neural Networks (RNN), Transformers, and Convolutional Neural Networks (CNN). While CNN is capable of extracting local spatial information from images, it lacks the ability to learn global spatial features and temporal memory features. Conversely, RNN relies on time and can retain significant sequential features. However, they are not proficient in extracting lengthy dependencies of sequence data in practical scenarios. The self-attention mechanism in the Transformer model has the capability of global feature extraction, but it does not adequately prioritize local features and cannot extract spatial and channel features. This paper proposes STFAC-ECGNet, a model that incorporates CAMV-RNN block, CBMV-CNN block, and TSEF block to enhance the performance of the model by integrating the strengths of CNN, RNN, and Transformer. The CAMV-RNN block incorporates a coordinated adaptive simplified self-attention module that adaptively carries out global sequence feature retention and enhances spatial-temporal information. The CBMV-CNN block integrates spatial and channel attentional mechanism modules in a skip connection, enabling the fusion of spatial and channel information. The TSEF block implements enhanced multi-scale fusion of image spatial and sequence temporal features. In this study, comprehensive experiments were conducted using the PTB-XL large publicly available ECG dataset and the China Physiological Signal Challenge 2018 (CPSC2018) database. The results indicate that STFAC-ECGNet surpasses other cutting-edge techniques in multiple tasks, showcasing robustness and generalization.

A Multimodal Deep Neural Network for ECG and PCG Classification with Multimodal Fusion

ECG Heartbeat Classification Using Multimodal Fusion

Multimodal multi-instance learning for long-term ECG classification

Multimodal ECG heartbeat classification method based on a convolutional neural network embedded with FCA

An Improved ConvNeXt with Multimodal Transformer for Physiological Signal Classification

Automated Heartbeat Classification Exploiting Convolutional Neural Network with Channel-Wise Attention

A pooling convolution model for multi-classification of ECG and PCG signals

Automatic Recognition of Coronary Artery Disease and Congestive Heart Failure Using a Multi-Granularity Cascaded Hybrid Network

12-Lead ECG signal classification for detecting ECG arrhythmia via an information bottleneck-based multi-scale network

Multimodal fusion with deep neural networks for leveraging CT imaging and electronic health record: a case-study in pulmonary embolism detection

A Multimodal Multilevel Converged Attention Network for Hand Gesture Recognition With Hybrid sEMG and A-Mode Ultrasound Sensing

A Multi-Resolution Mutual Learning Network for Multi-Label ECG Classification

Enhanced multi-label cardiology diagnosis with channel-wise recurrent fusion

Classification of Phonocardiogram Based on Multi-View Deep Network

An Electrocardiogram Classification Using a Multiscale Convolutional Causal Attention Network

Multi-Lead ECG Classification via an Information-Based Attention Convolutional Neural Network

MCG-Net: End-to-End Fine-Grained Delineation and Diagnostic Classification of Cardiac Events From Magnetocardiographs

Multimodal 12-lead ECG data classification using multi-label DenseNet for heart disease detection

ECG Heart-beat Classification Using Multimodal Image Fusion

A coordinated adaptive multiscale enhanced spatio-temporal fusion network for multi-lead electrocardiogram arrhythmia detection

A novel feature-level fusion scheme with multimodal attention CNN for heart sound classification