Abstract:Introduction: This study aimed to identify differences in voice characteristics and changes between patients with dysphagia-aspiration and healthy individuals using a deep learning model, with a focus on under-researched areas of pre- and post-swallowing voice changes in patients with dysphagia. We hypothesized that these variations may be due to weakened muscles and blocked airways in patients with dysphagia. Methods: A prospective cohort study was conducted on 198 participants aged >40 years at the Seoul National University Bundang Hospital from October 2021 to February 2023. Pre- and post-swallowing voice data of the participants were converted to a 64-kbps mp3 format, and all voice data were trimmed to a length of 2 s. The data were divided for 10-fold cross-validation and stored in HDF5 format with anonymized IDs and labels for the normal and aspiration groups. During preprocessing, the data were converted to Mel spectrograms, and the EfficientAT model was modified using the final layer of MobileNetV3 to effectively detect voice changes and analyze pre- and post-swallowing voices. This enabled the model to probabilistically categorize new patient voices as normal or aspirated. Results: In a study of the machine-learning model for aspiration detection, area under the receiver operating characteristic curve (AUC) values were analyzed across sexes under different configurations. The average AUC values for males ranged from 0.8117 to 0.8319, with the best performance achieved at a learning rate of 3.00e-5 and a batch size of 16. The average AUC values for females improved from 0.6975 to 0.7331, with the best performance observed at a learning rate of 5.00e-5 and a batch size of 32. As there were fewer female participants, a combined model was developed to maintain the sex balance. In the combined model, the average AUC values ranged from 0.7746 to 0.7997, and optimal performance was achieved at a learning rate of 3.00e-5 and a batch size of 16. Conclusion: This study evaluated a voice analysis-based program to detect pre- and post-swallowing changes in patients with dysphagia, potentially aiding in real-time monitoring. Such a system can provide healthcare professionals with daily insights into the conditions of patients, allowing for personalized interventions. Clinical trial registration: ClinicalTrials.gov, identifier NCT05149976.

A statistical analysis of cervical auscultation signals from adults with unsafe airway protection

Dysphagia Pattern in Early to Moderate Parkinson's Disease Caused by Abnormal Pharyngeal Kinematic Function.

Characterizing Swallows from People with Neurodegenerative Diseases Using High-Resolution Cervical Auscultation Signals and Temporal and Spatial Swallow Kinematic Measurements

Swallowing kinematic analysis might be helpful in predicting aspiration and pyriform sinus stasis

Establishing Reference Values for Temporal Kinematic Swallow Events Across the Lifespan in Healthy Community Dwelling Adults Using High-Resolution Cervical Auscultation.

Noninvasive and automatic diagnosis of patients at high risk of swallowing aspiration

A deep learning approach to dysphagia-aspiration detecting algorithm through pre- and post-swallowing voice changes

Assessment of Swallowing Function in Healthy Adults While Using High-Flow Nasal Cannula

Temporal Sequence of Laryngeal Vestibule Closure and Reopening is Associated with Airway Protection

Cervical Auscultation Machine Learning for Dysphagia Assessment

Oropharyngeal swallowing hydrodynamics of thin and mildly thick liquids in an anatomically accurate throat-epiglottis model

Automatic Estimation of Laryngeal Vestibule Closure Duration Using High- Resolution Cervical Auscultation Signals.

How Do Quantitative Videofluoroscopy Measures Differ Between People With Amyotrophic Lateral Sclerosis and Age-Matched Healthy Adults?

Pharyngoglottal Closure Reflex: Characterization in Healthy Young, Elderly and Dysphagic Patients with Predeglutitive Aspiration

Cough and aspiration of food and liquids due to oral-pharyngeal dysphagia: ACCP evidence-based clinical practice guidelines

Novel Approach Combining Shallow Learning and Ensemble Learning for the Automated Detection of Swallowing Sounds in a Clinical Database

Detecting pharyngeal post-swallow residue by ultrasound examination: a case series.

Oropharyngeal dysphagia profiles in individuals with oculopharyngeal muscular dystrophy

Developing a Swallow-State Monitoring System Using Nasal Airflow, Surface Electromyography, and Thyroid Cartilage Movement Detection

Cervical Auscultation for Detecting Oropharyngeal Aspiration in Paediatric and Adult Populations: A Systematic Review and Meta-Analysis

Using High‐Speed Videoendoscopy to Analyze Laryngeal Closure Parameters During Normal Swallow