Cutting Weights of Deep Learning Models for Heart Sound Classification: Introducing a Knowledge Distillation Approach

Zikai Song,Lixian Zhu,Yiyan Wang,Mengkai Sun,Kun Qian,Bin Hu,Yoshiharu Yamamoto,Bjorn W. Schuller
DOI: https://doi.org/10.1109/EMBC40787.2023.10340704
2023-01-01
Abstract:Cardiovascular diseases (CVDs) are the number one cause of death worldwide. In recent years, intelligent auxiliary diagnosis of CVDs based on computer audition has become a popular research field, and intelligent diagnosis technology is increasingly mature. Neural networks used to monitor CVDs are becoming more complex, requiring more computing power and memory, and are difficult to deploy in wearable devices. This paper proposes a lightweight model for classifying heart sounds based on knowledge distillation, which can be deployed in wearable devices to monitor the heart sounds of wearers. The network model is designed based on Convolutional Neural Networks (CNNs). Model performance is evaluated by extracting Mel Frequency Cepstral Coefficients (MFCCs) features from the PhysioNet/CinC Challenge 2016 dataset. The experimental results show that knowledge distillation can improve a lightweight network's accuracy, and our model performs well on the test set. Especially, when the knowledge distillation temperature is 7 and the weight alpha is 0.1, the accuracy is 88.5 %, the recall is 83.8 %, and the specificity is 93.6 %.
What problem does this paper attempt to address?