Abstract:Objective. The decline in the performance of electromyography (EMG)-based silent speech recognition is widely attributed to disparities in speech patterns, articulation habits, and individual physiology among speakers. Feature alignment by learning a discriminative network that resolves domain offsets across speakers is an effective method to address this problem. The prevailing adversarial network with a branching discriminator specializing in domain discrimination renders insufficiently direct contribution to categorical predictions of the classifier.Approach. To this end, we propose a simplified discrepancy-based adversarial network with a streamlined end-to-end structure for EMG-based cross-subject silent speech recognition. Highly aligned features across subjects are obtained by introducing a Nuclear-norm Wasserstein discrepancy metric on the back end of the classification network, which could be utilized for both classification and domain discrimination. Given the low-level and implicitly noisy nature of myoelectric signals, we devise a cascaded adaptive rectification network as the front-end feature extraction network, adaptively reshaping the intermediate feature map with automatically learnable channel-wise thresholds. The resulting features effectively filter out domain-specific information between subjects while retaining domain-invariant features critical for cross-subject recognition.Main results. A series of sentence-level classification experiments with 100 Chinese sentences demonstrate the efficacy of our method, achieving an average accuracy of 89.46% tested on 40 new subjects by training with data from 60 subjects. Especially, our method achieves a remarkable 10.07% improvement compared to the state-of-the-art model when tested on 10 new subjects with 20 subjects employed for training, surpassing its result even with three times training subjects.Significance. Our study demonstrates an improved classification performance of the proposed adversarial architecture using cross-subject myoelectric signals, providing a promising prospect for EMG-based speech interactive application.

Bioinspired dual-channel speech recognition using graphene-based electromyographic and mechanical sensors

Attention Bidirectional LSTM Networks Based Mime Speech Recognition Using Semg Data

Silent Speech Decoding Using Spectrogram Features Based on Neuromuscular Activities

Silent Speech Recognition based on sEMG and EEG Signals

Hybrid Silent Speech Interface Through Fusion of Electroencephalography and Electromyography

Speech neuromuscular decoding based on spectrogram images using conformal predictors with Bi-LSTM.

Multimodal Speech Recognition Using EEG and Audio Signals: A Novel Approach for Enhancing ASR Systems

Mixed-modality speech recognition and interaction using a wearable artificial throat

Deep Learning Enabled High-Performance Speech Command Recognition on Graphene Flexible Microphones

All-weather, natural silent speech recognition via machine-learning-assisted tattoo-like electronics

Graphene‐based Dual‐function Acoustic Transducers for Machine Learning‐assisted Human–robot Interfaces

Feature selection of mime speech recognition using surface electromyography data

Silent Speech Recognition Based on Surface Electromyography

A novel silent speech recognition approach based on parallel inception convolutional neural network and Mel frequency spectral coefficient

Temporal Convolutional Network-Enhanced Real-Time Implicit Emotion Recognition with an Innovative Wearable fNIRS-EEG Dual-Modal System

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Silent Speech Recognition Based on Surface Electromyography Using a Few Electrode Sites under the Guidance from High-Density Electrode Arrays.

A simplified adversarial architecture for cross-subject silent speech recognition using electromyography

Design and implementation of a silent speech recognition system based on sEMG signals: A neural network approach

Silent Speech Recognition Based on High-Density Surface Electromyogram Using Hybrid Neural Networks

Wearable Wireless Dual-Channel EEG System for Emotion Recognition Based on Machine Learning