Abstract:Objective. The decline in the performance of electromyography (EMG)-based silent speech recognition is widely attributed to disparities in speech patterns, articulation habits, and individual physiology among speakers. Feature alignment by learning a discriminative network that resolves domain offsets across speakers is an effective method to address this problem. The prevailing adversarial network with a branching discriminator specializing in domain discrimination renders insufficiently direct contribution to categorical predictions of the classifier.Approach. To this end, we propose a simplified discrepancy-based adversarial network with a streamlined end-to-end structure for EMG-based cross-subject silent speech recognition. Highly aligned features across subjects are obtained by introducing a Nuclear-norm Wasserstein discrepancy metric on the back end of the classification network, which could be utilized for both classification and domain discrimination. Given the low-level and implicitly noisy nature of myoelectric signals, we devise a cascaded adaptive rectification network as the front-end feature extraction network, adaptively reshaping the intermediate feature map with automatically learnable channel-wise thresholds. The resulting features effectively filter out domain-specific information between subjects while retaining domain-invariant features critical for cross-subject recognition.Main results. A series of sentence-level classification experiments with 100 Chinese sentences demonstrate the efficacy of our method, achieving an average accuracy of 89.46% tested on 40 new subjects by training with data from 60 subjects. Especially, our method achieves a remarkable 10.07% improvement compared to the state-of-the-art model when tested on 10 new subjects with 20 subjects employed for training, surpassing its result even with three times training subjects.Significance. Our study demonstrates an improved classification performance of the proposed adversarial architecture using cross-subject myoelectric signals, providing a promising prospect for EMG-based speech interactive application.

Quality-aware Aggregated Conformal Prediction for Silent Speech Recognition

Inductive conformal prediction for silent speech recognition

Speech neuromuscular decoding based on spectrogram images using conformal predictors with Bi-LSTM.

Silent Speech Recognition Based on Surface Electromyography

Silent Speech Decoding Using Spectrogram Features Based on Neuromuscular Activities

Silent Speech Recognition based on sEMG and EEG Signals

Hybrid Silent Speech Interface Through Fusion of Electroencephalography and Electromyography

Simplified Deformation Compensation for Emotional Speaker Recognition

Silent Speech Recognition Based on Surface Electromyography Using a Few Electrode Sites under the Guidance from High-Density Electrode Arrays.

Exploration on Channel-interactive Features in Silent Speech Recognition

Design and implementation of a silent speech recognition system based on sEMG signals: A neural network approach

Silent Speech Recognition Based on High-Density Surface Electromyogram Using Hybrid Neural Networks

Encoder-Decoder Architectures for Silent Speech Recognition Based on High-density Surface Electromyogram

Decoding Silent Speech Based on High-Density Surface Electromyogram Using Spatiotemporal Neural Network

sEMG-based technology for silent voice recognition

Extracting Spatial Muscle Activation Patterns in Facial and Neck Muscles for Silent Speech Recognition Using High-Density sEMG

Real-time Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Feature selection of mime speech recognition using surface electromyography data

A simplified adversarial architecture for cross-subject silent speech recognition using electromyography

Preprocessing Improvement in Mime Speech Recognition based on Surface Electromyogram

A novel silent speech recognition approach based on parallel inception convolutional neural network and Mel frequency spectral coefficient