Abstract:Cardiovascular disease (CVDs) has become one of the leading causes of death, posing a significant threat to human life. The development of reliable Artificial Intelligence (AI) assisted diagnosis algorithms for cardiac sounds is of great significance for early detection and treatment of CVDs. However, there is scarce research in this field. Existing research mainly faces three major challenges: (1) They mainly limited to murmur classification and cannot achieve murmur grading, but attempting both classification and grading may lead to negative effects between different multi-tasks. (2) They mostly pay attention to unstructured cardiac sound modality and do not consider the structured demographic modality, as it is difficult to balance the influence of heterogeneous modalities. (3) Deep learning methods lack interpretability, which makes it challenging to apply them clinically. To tackle these challenges, we propose a method for cardiac murmur grading and cardiac risk analysis based on heterogeneous modality adaptive multi-task learning. Specifically, a Hierarchical Multi-Task learning-based cardiac murmur detection and grading method (HMT) is proposed to prevent negative interference between different tasks. In addition, a cardiac risk analysis method based on Heterogeneous Multi-modal feature impact Adaptation (HMA) is also proposed, which transforms unstructured modality into structured modality representation, and utilizes an adaptive mode weight learning mechanism to balance the impact between unstructured modality and structured modality, thus enhancing the performance of cardiac risk prediction. Finally, we propose a multi-task interpretability learning module that incorporates an important evaluation using random masks. This module utilizes SHAP graphs to visualize crucial murmur segments in cardiac sound and employs a multi-factor risk decoupling model based on nomograms. And then we gain insights into the cardiac disease risk in both pre-decoupled multi-modality and post-decoupled single-modality scenarios, thus providing a solid foundation for AI assisted cardiac murmur grading and risk analysis. Experimental results on a large real-world CirCor DigiScope PCG dataset demonstrate that the proposed method outperforms the state-of-the-art (SOTA) method in murmur detection, grading, and cardiac risk analysis, while also providing valuable diagnostic evidence.

A machine-learning algorithm to grade heart murmurs and stage preclinical myxomatous mitral valve disease in dogs

A Deep Learning Algorithm for Automated Cardiac Murmur Detection Via a Digital Stethoscope Platform

Machine learning-based risk prediction model for canine myxomatous mitral valve disease using electronic health record data

Deep Learning Algorithms to Detect Murmurs Associated With Structural Heart Disease

Algorithm for predicting valvular heart disease from heart sounds in an unselected cohort

Cardiac Murmur Grading and Risk Analysis of Cardiac Diseases Based on Adaptable Heterogeneous-Modality Multi-Task Learning

Automated valvular heart disease detection using heart sound with a deep learning algorithm

Identification of congenital valvular murmurs in young patients using deep learning-based attention transformers and phonocardiograms

An Automated Machine Learning-Based Quantitative Multiparametric Approach for Mitral Regurgitation Severity Grading

Machine Learning for Pediatric Echocardiographic Mitral Regurgitation Detection

External evaluation of a commercial artificial intelligence-augmented digital auscultation platform in valvular heart disease detection using echocardiography as reference standard

Developing an AI-assisted digital auscultation tool for automatic assessment of the severity of mitral regurgitation: protocol for a cross-sectional, non-interventional study

A Computer-Aided Heart Valve Disease Diagnosis System Based on Machine Learning

Intelligent Cardiac Auscultation for Murmur Detection via Parallel-Attentive Models with Uncertainty Estimation

Prognostic value of echocardiographic indices of left atrial morphology and function in dogs with myxomatous mitral valve disease

The Virtual Cardiologist: Three Deep Learning Pipelines in an Inexpensive Portable Device and Web/Mobile Application for Rapid Cardiovascular Diagnosis and Clinical Decision-Making

Temporal changes in clinical and radiographic variables in dogs with preclinical myxomatous mitral valve disease: The EPIC study

Quantification of respiratory sinus arrhythmia in control dogs and in dogs with various severity classes of myxomatous mitral valve disease

Automated Analysis of Doppler Echocardiographic Videos as a Screening Tool for Valvular Heart Diseases

Heart Murmur Severity Stages Classification Using Multi-kernel Residual CNN

Neural network analysis of pharyngeal sounds can detect obstructive upper respiratory disease in brachycephalic dogs