Multi-modality Multi-attention Network for Ventricular Arrhythmia Classification

Qingjun Wang,Mujun Zang,Tong Liu,Zhimin Xu,Shusen Zhou,Chanjuan Liu
DOI: https://doi.org/10.1145/3592686.3592746
2023-02-10
Abstract:Classification of Ventricular arrhythmia is a significant topic because Ventricular arrhythmia is one of the deadliest disease. Electrocardiogram (ECG) plays an important role in diagnosing by clinical physicians. However, most of the existing models are designed based on single-modality, the performance will be limited. For further exploring multi-modality correlationship, a Multi-modality Multi-attention Network (MMNet) was proposed, which was consisted by two stages: multi-modality feature extraction encoding and multi-attention feature fusion. At the first stage, signals were converted into images, then, the signal encoder and image encoder extracted features from two modalities. At the second stage, cross-attention fused two single- modality features, and fused features with multi-modality correlations were obtained by self-attention further processed. In order to verify the performance of the MMNet comprehensively, we performed dataset partitioning according to inter-patient paradigm under AAMI standard and conducted experiments on MIT-BIH arrhythmia database. The results showed that our proposed MMNet achieved an average accuracy of 97.72% on Ventricular ectopic beats (V) and any not in the V-type beats (NV). And specificity of 98.72%, sensitivity of 83.29%, precision of 81.87%, F1_score of 82.57% on V-type. These results demonstrated that our MMNet has better Ventricular arrhythmia classification performance compared to other models.
Medicine,Computer Science
What problem does this paper attempt to address?