Abstract:Introduction: Post-stroke dysphagia is common and associated with significant morbidity and mortality, rendering bedside screening of significant clinical importance. Using voice as a biomarker coupled with deep learning has the potential to improve patient access to screening and mitigate the subjectivity associated with detecting voice change, a component of several validated screening protocols. Methods: In this single-center study, we developed a proof-of-concept model for automated dysphagia screening and evaluated the performance of this model on training and testing cohorts. Patients were admitted to a comprehensive stroke center, where primary English speakers could follow commands without significant aphasia and participated on a rolling basis. The primary outcome was classification either as a pass or fail equivalent using a dysphagia screening test as a label. Voice data was recorded from patients who spoke a standardized set of vowels, words, and sentences from the National Institute of Health Stroke Scale. Seventy patients were recruited and 68 were included in the analysis, with 40 in training and 28 in testing cohorts, respectively. Speech from patients was segmented into 1,579 audio clips, from which 6,655 Mel-spectrogram images were computed and used as inputs for deep-learning models (DenseNet and ConvNext, separately and together). Clip-level and participant-level swallowing status predictions were obtained through a voting method. Results: The models demonstrated clip-level dysphagia screening sensitivity of 71% and specificity of 77% (F1 = 0.73, AUC = 0.80 [95% CI: 0.78-0.82]). At the participant level, the sensitivity and specificity were 89 and 79%, respectively (F1 = 0.81, AUC = 0.91 [95% CI: 0.77-1.05]). Discussion: This study is the first to demonstrate the feasibility of applying deep learning to classify vocalizations to detect post-stroke dysphagia. Our findings suggest potential for enhancing dysphagia screening in clinical settings. https://github.com/UofTNeurology/masa-open-source.

A review on intelligent aid diagnosis for dysphagia using swallowing sounds

Advancements and Challenges in Non-Invasive Sensor Technologies for Swallowing Assessment: A Review

Dysphagia diagnosis system with integrated speech analysis from throat vibration

Smart Dysphagia Detection System with Adaptive Boosting Analysis of Throat Signals.

Automatic Clinical Assessment of Swallowing Behavior and Diagnosis of Silent Aspiration Using Wireless Multimodal Wearable Electronics

A Wearable Swallowing Recognition System Based on Motion and Dual Photoplethysmography Sensing of Laryngeal Movements

Cervical Auscultation Machine Learning for Dysphagia Assessment

Comprehensive review of dysphagia and technological advances in dysphagia food

Review of Intelligent, Flexible Artificial Throats with Sound Emitting, Detecting, and Recognizing Ability

Deep learning approach for dysphagia detection by syllable-based speech analysis with daily conversations

Noninvasive and automatic diagnosis of patients at high risk of swallowing aspiration

Machine-learning assisted swallowing assessment: a deep learning-based quality improvement tool to screen for post-stroke dysphagia

Neural and cortical analysis of swallowing and detection of motor imagery of swallow for dysphagia rehabilitation-A review

Comprehensive assessment and treatment strategies for dysphagia in the elderly population: Current status and prospects

A Novel Approach for Swallow Detection by Fusing Throat Acceleration and PPG Signal.

Intelligent, Flexible Artificial Throats with Sound Emitting, Detecting, and Recognizing Abilities

A Wearable Swallowing Detecting Method Based on Nanometer Materials Sensor

The Development of an Artificial Intelligence Video Analysis-Based Web Application to Diagnose Oropharyngeal Dysphagia: A Pilot Study

Developing a Swallow-State Monitoring System Using Nasal Airflow, Surface Electromyography, and Thyroid Cartilage Movement Detection

Research progress in the risk factors and screening assessment of dysphagia in the elderly

Multi-Scale Spatial and Temporal Speech Associations to Swallowing for Dysphagia Screening.