Abstract:Cardiovascular disease (CVDs) has become one of the leading causes of death, posing a significant threat to human life. The development of reliable Artificial Intelligence (AI) assisted diagnosis algorithms for cardiac sounds is of great significance for early detection and treatment of CVDs. However, there is scarce research in this field. Existing research mainly faces three major challenges: (1) They mainly limited to murmur classification and cannot achieve murmur grading, but attempting both classification and grading may lead to negative effects between different multi-tasks. (2) They mostly pay attention to unstructured cardiac sound modality and do not consider the structured demographic modality, as it is difficult to balance the influence of heterogeneous modalities. (3) Deep learning methods lack interpretability, which makes it challenging to apply them clinically. To tackle these challenges, we propose a method for cardiac murmur grading and cardiac risk analysis based on heterogeneous modality adaptive multi-task learning. Specifically, a Hierarchical Multi-Task learning-based cardiac murmur detection and grading method (HMT) is proposed to prevent negative interference between different tasks. In addition, a cardiac risk analysis method based on Heterogeneous Multi-modal feature impact Adaptation (HMA) is also proposed, which transforms unstructured modality into structured modality representation, and utilizes an adaptive mode weight learning mechanism to balance the impact between unstructured modality and structured modality, thus enhancing the performance of cardiac risk prediction. Finally, we propose a multi-task interpretability learning module that incorporates an important evaluation using random masks. This module utilizes SHAP graphs to visualize crucial murmur segments in cardiac sound and employs a multi-factor risk decoupling model based on nomograms. And then we gain insights into the cardiac disease risk in both pre-decoupled multi-modality and post-decoupled single-modality scenarios, thus providing a solid foundation for AI assisted cardiac murmur grading and risk analysis. Experimental results on a large real-world CirCor DigiScope PCG dataset demonstrate that the proposed method outperforms the state-of-the-art (SOTA) method in murmur detection, grading, and cardiac risk analysis, while also providing valuable diagnostic evidence.

Exploring Pre-trained General-purpose Audio Representations for Heart Murmur Detection

Listen2YourHeart: A Self-Supervised Approach for Detecting Murmur in Heart-Beat Sounds

A Deep Learning Algorithm for Automated Cardiac Murmur Detection Via a Digital Stethoscope Platform

Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram

Masked Modeling Duo: Towards a Universal Audio Pre-training Framework

Deep Learning Algorithms to Detect Murmurs Associated With Structural Heart Disease

Intelligent Cardiac Auscultation for Murmur Detection via Parallel-Attentive Models with Uncertainty Estimation

MCHeart: Multi-Channel-Based Heart Signal Processing Scheme for Heart Noise Detection Using Deep Learning

Identification of congenital valvular murmurs in young patients using deep learning-based attention transformers and phonocardiograms

Segmental Convolutional Neural Networks for Detection of Cardiac Abnormality With Noisy Heart Sound Recordings

Learning Representations from Heart Sound: A Comparative Study on Shallow and Deep Models

Artificial intelligence framework for heart disease classification from audio signals

Generative Deep Learning and Signal Processing for Data Augmentation of Cardiac Auscultation Signals: Improving Model Robustness Using Synthetic Audio

Transfer Learning Models for Detecting Six Categories of Phonocardiogram Recordings

Cardiac Murmur Grading and Risk Analysis of Cardiac Diseases Based on Adaptable Heterogeneous-Modality Multi-Task Learning

Heart Murmur and Abnormal PCG Detection via Wavelet Scattering Transform & a 1D-CNN

Identifying pediatric heart murmurs and distinguishing innocent from pathologic using deep learning

Masked Modeling Duo for Speech: Specializing General-Purpose Audio Representation to Speech using Denoising Distillation

Deep Learning in Heart Sound Analysis: From Techniques to Clinical Applications

Murmur identification and outcome prediction in phonocardiograms using deep features based on Stockwell transform

Searching for Effective Neural Network Architectures for Heart Murmur Detection from Phonocardiogram