Abstract:The advantages of non-invasive, real-time and convenient, computer audition-based heart sound abnormality detection methods have increasingly attracted efforts among the community of cardiovascular diseases. Time-frequency analyses are crucial for computer audition-based applications. However, a comprehensive investigation on discovering an optimised way for extracting time-frequency representations from heart sounds is lacking until now. To this end, we propose a comprehensive investigation on time-frequency methods for analysing the heart sound, i.e., short-time Fourier transformation, Log-Mel transformation, Hilbert-Huang transformation, wavelet transformation, Mel transformation, and Stockwell transformation. The time-frequency representations are automatically learnt via pre-trained deep convolutional neural networks. Considering the urgent need of smart stethoscopes for high robust detection algorithms in real environment, the training, verification, and testing sets employed in the extensive evaluation are subject-independent. Finally, to further understand the heart sound-based digital phenotype for cardiovascular diseases, explainable artificial intelligence approaches are used to reveal the reasons for the performance differences of four time-frequency representations in heart sound abnormality detection. Experimental results show that Stockwell transformation can beat other methods by reaching the highest overall score of 65.2%. The interpretable results demonstrate that Stockwell transformation does not only present more information for heart sounds, but also provides a certain noise robustness. Besides, the considered fine-tuned deep model brings an improvement of the mean accuracy over the previous state-of-the-art results by 9.0% in subject-independent testing.

Heart sound signal recovery based on time series signal prediction using a recurrent neural network in the long short-term memory model

High-Performance Personalized Heartbeat Classification Model for Long-Term ECG Signal

Exploring Interpretable Representations for Heart Sound Abnormality Detection

Abnormal Heart Sound Detection Using Temporal Quasi-Periodic Features and Long Short-Term Memory Without Segmentation.

Heart sound recognition technology based on convolutional neural network

[A Heart Sound Classification Method Based on Joint Decision of Extreme Gradient Boosting and Deep Neural Network].

A robust method for heart sounds classification based on empirical mode decomposition adaptive reconstruction.

MCHeart: Multi-Channel-Based Heart Signal Processing Scheme for Heart Noise Detection Using Deep Learning

Deep learning neural nets for detecting heart activity

Heart sound classification based on improved mel-frequency spectral coefficients and deep residual learning

A Robust Deep Learning Framework Based on Spectrograms for Heart Sound Classification

Prediction of hearing recovery with deep learning algorithm in sudden sensorineural hearing loss

Heart Sound Classification Using Residual Neural Network and Convolution Block Attention Module

A Heart Sound Signal Classification Method Based on the Mixed Characteristics of Mel Cepstrum Coefficient and Second-Order Spectrum

The heart sound classification of congenital heart disease by using median EEMD-Hurst and threshold denoising method

Segmental Convolutional Neural Networks for Detection of Cardiac Abnormality With Noisy Heart Sound Recordings

A Short-term ECG Signal Classification Method Based on Residual Network and Bi-directional LSTM

Application of EMD and Correlation Dimension in Classification and Recognition of Heart Sound

A learnable front-end based efficient channel attention network for heart sound classification

Deep Learning Radar for High Fidelity Heart Sound Recovery in Real-World Scenarios

Heart Sound Classification Considering Additive Noise and Convolutional Distortion