Abstract:Cardiovascular disease (CVDs) has become one of the leading causes of death, posing a significant threat to human life. The development of reliable Artificial Intelligence (AI) assisted diagnosis algorithms for cardiac sounds is of great significance for early detection and treatment of CVDs. However, there is scarce research in this field. Existing research mainly faces three major challenges: (1) They mainly limited to murmur classification and cannot achieve murmur grading, but attempting both classification and grading may lead to negative effects between different multi-tasks. (2) They mostly pay attention to unstructured cardiac sound modality and do not consider the structured demographic modality, as it is difficult to balance the influence of heterogeneous modalities. (3) Deep learning methods lack interpretability, which makes it challenging to apply them clinically. To tackle these challenges, we propose a method for cardiac murmur grading and cardiac risk analysis based on heterogeneous modality adaptive multi-task learning. Specifically, a Hierarchical Multi-Task learning-based cardiac murmur detection and grading method (HMT) is proposed to prevent negative interference between different tasks. In addition, a cardiac risk analysis method based on Heterogeneous Multi-modal feature impact Adaptation (HMA) is also proposed, which transforms unstructured modality into structured modality representation, and utilizes an adaptive mode weight learning mechanism to balance the impact between unstructured modality and structured modality, thus enhancing the performance of cardiac risk prediction. Finally, we propose a multi-task interpretability learning module that incorporates an important evaluation using random masks. This module utilizes SHAP graphs to visualize crucial murmur segments in cardiac sound and employs a multi-factor risk decoupling model based on nomograms. And then we gain insights into the cardiac disease risk in both pre-decoupled multi-modality and post-decoupled single-modality scenarios, thus providing a solid foundation for AI assisted cardiac murmur grading and risk analysis. Experimental results on a large real-world CirCor DigiScope PCG dataset demonstrate that the proposed method outperforms the state-of-the-art (SOTA) method in murmur detection, grading, and cardiac risk analysis, while also providing valuable diagnostic evidence.

Heart Murmur Severity Stages Classification Using Multi-kernel Residual CNN

Heart Murmur and Abnormal PCG Detection via Wavelet Scattering Transform & a 1D-CNN

Searching for Effective Neural Network Architectures for Heart Murmur Detection from Phonocardiogram

Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram

Cardiac Murmur Grading and Risk Analysis of Cardiac Diseases Based on Adaptable Heterogeneous-Modality Multi-Task Learning

MCHeart: Multi-Channel-Based Heart Signal Processing Scheme for Heart Noise Detection Using Deep Learning

Murmur identification and outcome prediction in phonocardiograms using deep features based on Stockwell transform

Heart Murmur Detection from Phonocardiogram Based on Residual Neural Network with Classes Distinguished Focal Loss

Intellectual heartbeats classification model for diagnosis of heart disease from ECG signal using hybrid convolutional neural network with GOA

Automated Heartbeat Classification Exploiting Convolutional Neural Network with Channel-Wise Attention

A novel feature-level fusion scheme with multimodal attention CNN for heart sound classification

Cardiovascular Disease Recognition Based on Heartbeat Segmentation and Selection Process

FunnelNet: An End-to-End Deep Learning Framework to Monitor Digital Heart Murmur in Real-Time

Identifying pediatric heart murmurs and distinguishing innocent from pathologic using deep learning

Identification of congenital valvular murmurs in young patients using deep learning-based attention transformers and phonocardiograms

Graph convolutional network‐based deep feature learning for cardiovascular disease recognition from heart sound signals

NRC-Net: Automated noise robust cardio net for detecting valvular cardiac diseases using optimum transformation method with heart sound signals

Multichannel Multiscale Two-Stage Convolutional Neural Network for the Detection and Localization of Myocardial Infarction Using Vectorcardiogram Signal

Classification of Heart Sounds Using Multi-Branch Deep Convolutional Network and LSTM-CNN

Deep residual 2D convolutional neural network for cardiovascular disease classification

Automatic Classification of Normal–Abnormal Heart Sounds Using Convolution Neural Network and Long-Short Term Memory