Abstract:Objective. Silent speech recognition (SSR) based on surface electromyography (sEMG) is an attractive non-acoustic modality of human-machine interfaces that convert the neuromuscular electrophysiological signals into computer-readable textual messages. The speaking process involves complex neuromuscular activities spanning a large area over the facial and neck muscles, thus the locations of the sEMG electrodes considerably affected the performance of the SSR system. However, most of the previous studies used only a quite limited number of electrodes that were placed empirically without prior quantitative analysis, resulting in uncertainty and unreliability of the SSR outcomes.Approach. In this study, the technique of high-density sEMG was proposed to provide a full representation of the articulatory muscle activities so that the optimal electrode configuration for SSR could be systemically explored. A total of 120 closely spaced electrodes were placed on the facial and neck muscles to collect the high-density sEMG signals for classifying ten digits (0-9) silently spoken in both English and Chinese. The sequential forward selection algorithm was adopted to explore the optimal electrodes configurations.Main Results.The results showed that the classification accuracy increased rapidly and became saturated quickly when the number of selected electrodes increased from 1 to 120. Using only ten optimal electrodes could achieve a classification accuracy of 86% for English and 94% for Chinese, whereas as many as 40 non-optimized electrodes were required to obtain comparable accuracies. Also, the optimally selected electrodes seemed to be mostly distributed on the neck instead of the facial region, and more electrodes were required for English recognition to achieve the same accuracy.Significance. The findings of this study can provide useful guidelines about electrode placement for developing a clinically feasible SSR system and implementing a promising approach of human-machine interface, especially for patients with speaking difficulties.

Towards EMG-to-Speech with a Necklace Form Factor

Speech neuromuscular decoding based on spectrogram images using conformal predictors with Bi-LSTM.

Convolutional Neural Network applied in mime speech recognition using sEMG data

Attention Bidirectional LSTM Networks Based Mime Speech Recognition Using Semg Data

Towards Optimizing Electrode Configurations for Silent Speech Recognition Based on High-Density Surface Electromyography.

Automatic Speech Recognition in Different Languages Using High-Density Surface Electromyography Sensors

Extracting Spatial Muscle Activation Patterns in Facial and Neck Muscles for Silent Speech Recognition Using High-Density sEMG

Comparison of Contributions Between Facial and Neck Muscles for Speech Recognition Using High-Density Surface Electromyography.

Left/right Contributions of Articulatory Muscles in Speech Recognition Using High-Density Surface Electromyography

A Stretchable High-Density Electromyography Mems Sensor for Efficient Silent Speech Recognition

The Effects of Electrode Locations on Silent Speech Recognition Using High-Density Semg

SSR Using Portable Semg Acquisition System with Electrode Layout Optimization

Feature selection of mime speech recognition using surface electromyography data

Geometry of orofacial neuromuscular signals: speech articulation decoding using surface electromyography

Silent Speech Recognition Based on Surface Electromyography Using a Few Electrode Sites under the Guidance from High-Density Electrode Arrays.

Electromyogram-Based Lip-Reading via Unobtrusive Dry Electrodes and Machine Learning Methods.

Electromyogram-strain synergetic intelligent artificial throat

Stretchable and durable HD-sEMG electrodes for accurate recognition of swallowing activities on complex epidermal surfaces

Silent Speech Recognition Based on High-Density Surface Electromyogram Using Hybrid Neural Networks

A Super-Flexible and High-Sensitive Epidermal Semg Electrode Patch for Silent Speech Recognition

A Perifacial EMG Acquisition System for Facial-Muscle-Movement Recognition