Abstract:Introduction: This study aimed to identify differences in voice characteristics and changes between patients with dysphagia-aspiration and healthy individuals using a deep learning model, with a focus on under-researched areas of pre- and post-swallowing voice changes in patients with dysphagia. We hypothesized that these variations may be due to weakened muscles and blocked airways in patients with dysphagia. Methods: A prospective cohort study was conducted on 198 participants aged >40 years at the Seoul National University Bundang Hospital from October 2021 to February 2023. Pre- and post-swallowing voice data of the participants were converted to a 64-kbps mp3 format, and all voice data were trimmed to a length of 2 s. The data were divided for 10-fold cross-validation and stored in HDF5 format with anonymized IDs and labels for the normal and aspiration groups. During preprocessing, the data were converted to Mel spectrograms, and the EfficientAT model was modified using the final layer of MobileNetV3 to effectively detect voice changes and analyze pre- and post-swallowing voices. This enabled the model to probabilistically categorize new patient voices as normal or aspirated. Results: In a study of the machine-learning model for aspiration detection, area under the receiver operating characteristic curve (AUC) values were analyzed across sexes under different configurations. The average AUC values for males ranged from 0.8117 to 0.8319, with the best performance achieved at a learning rate of 3.00e-5 and a batch size of 16. The average AUC values for females improved from 0.6975 to 0.7331, with the best performance observed at a learning rate of 5.00e-5 and a batch size of 32. As there were fewer female participants, a combined model was developed to maintain the sex balance. In the combined model, the average AUC values ranged from 0.7746 to 0.7997, and optimal performance was achieved at a learning rate of 3.00e-5 and a batch size of 16. Conclusion: This study evaluated a voice analysis-based program to detect pre- and post-swallowing changes in patients with dysphagia, potentially aiding in real-time monitoring. Such a system can provide healthcare professionals with daily insights into the conditions of patients, allowing for personalized interventions. Clinical trial registration: ClinicalTrials.gov, identifier NCT05149976.

Flexible Throat Patch for Phonetic Recognition and Ingestion Monitoring via Sensory Transition based on Machine Learning (Adv. Mater. Technol. 10/2024)

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

Speech Recognition Using Intelligent Piezoresistive Sensor Based on Polystyrene Sphere Microstructures

A Wearable Swallowing Recognition System Based on Motion and Dual Photoplethysmography Sensing of Laryngeal Movements

Deep‐Learning‐Enabled MXene‐Based Artificial Throat: Toward Sound Detection and Speech Recognition

An epidermal sEMG tattoo-like patch as a new human-machine interface for patients with loss of voice

Decoding Throat-language Using Flexibility Sensors with Machine Learning

A Novel Approach for Swallow Detection by Fusing Throat Acceleration and PPG Signal.

Artificial Intelligence-Assisted Throat Sensor Using Ionic Polymer–Metal Composite (IPMC) Material

A fully integrated, standalone stretchable device platform with in-sensor adaptive machine learning for rehabilitation

Electromyogram-strain synergetic intelligent artificial throat

Twistable and Stretchable Nasal Patch for Monitoring Sleep-Related Breathing Disorders Based on a Stacking Ensemble Learning Model

Stretchable and durable HD-sEMG electrodes for accurate recognition of swallowing activities on complex epidermal surfaces

A Machine Learning-Combined Flexible Sensor for Tactile Detection and Voice Recognition

An Intelligent Artificial Throat with Sound-Sensing Ability Based on Laser Induced Graphene

Mixed-modality speech recognition and interaction using a wearable artificial throat

A High-Fidelity Skin-Attachable Acoustic Sensor for Realizing Auditory Electronic Skin

A Wearable Skin-Like Ultra-Sensitive Artificial Graphene Throat.

A deep learning approach to dysphagia-aspiration detecting algorithm through pre- and post-swallowing voice changes

Highly Conductive and Sensitive Wearable Strain Sensors with Metal/Nanoparticle Double Layer for Noninterference Voice Detection

Speaking without vocal folds using a machine-learning-assisted wearable sensing-actuation system