Abstract:Hand gesture recognition based on sparse multichannel surface electromyography (sEMG) still poses a significant challenge to deployment as a muscle–computer interface. Many researchers have been working to develop an sEMG-based hand gesture recognition system. However, the existing system still faces challenges in achieving satisfactory performance due to ineffective feature enhancement, so the prediction is erratic and unstable. To comprehensively tackle these challenges, we introduce a novel approach: a lightweight sEMG-based hand gesture recognition system using a 4-stream deep learning architecture. Each stream strategically combines Temporal Convolutional Network (TCN)-based time-varying features with Convolutional Neural Network (CNN)-based frame-wise features. In the first stream, we harness the power of the TCN module to extract nuanced time-varying temporal features. The second stream integrates a hybrid Long short-term memory (LSTM)-TCN module. This stream extracts temporal features using LSTM and seamlessly enhances them with TCN to effectively capture intricate long-range temporal relations. The third stream adopts a spatio-temporal strategy, merging the CNN and TCN modules. This integration facilitates concurrent comprehension of both spatial and temporal features, enriching the model's understanding of the underlying dynamics of the data. The fourth stream uses a skip connection mechanism to alleviate potential problems of data loss, ensuring a robust information flow throughout the network and concatenating the 4 stream features, yielding a comprehensive and effective final feature representation. We employ a channel attention-based feature selection module to select the most effective features, aiming to reduce the computational complexity and feed them into the classification module. The proposed model achieves an average accuracy of 94.31% and 98.96% on the Ninapro DB1 and DB9 datasets, respectively. This high-performance accuracy proves the superiority of the proposed model, and its implications extend to enhancing the quality of life for individuals using prosthetic limbs and advancing control systems in the field of robotic human–machine interfaces.

Complex Surface Electromyography Signal Gesture Recognition Based on Multipathway Featured Scale Convolutional Neural Network

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

Gesture Recognition Using Surface Electromyography and Deep Learning for Prostheses Hand: State-of-the-Art, Challenges, and Future

From Forearm to Wrist: Deep Learning for Surface Electromyography-Based Gesture Recognition.

Improving Hand Gesture Recognition Robustness to Dynamic Posture Variations by Multimodal Deep Feature Fusion

Dynamic Gesture Recognition Using Surface EMG Signals Based on Multi-Stream Residual Network

Dual Stream Long Short-Term Memory Feature Fusion Classifier for Surface Electromyography Gesture Recognition

Multi-gesture Recognition Method of Single-Channel EMG Signal Based on Deep Learning

Towards Integration of Domain Knowledge-Guided Feature Engineering and Deep Feature Learning in Surface Electromyography-Based Hand Movement Recognition

Gesture recognition based on sEMG using multi-attention mechanism for remote control

Pattern recognition of surface electromyography based on multi-scale convolutional neural network with attention mechanism.

Simultaneous Semg Recognition of Gestures and Force Levels for Interaction with Prosthetic Hand

Semg-Based Gesture Recognition Using Deep Learning from Noisy Labels.

A fully connected deep learning approach to upper limb gesture recognition in a secure FES rehabilitation environment

Hand gesture recognition using sEMG signals with a multi-stream time-varying feature enhancement approach

A Teleoperated Manipulator Control System Based on Surface Electromyography Using Deep Learning

Multi-Task Learning for Simultaneous Gesture and Force Level Recognition towards Prosthetic Hand Interaction

A Gesture Recognition System Based on Time Domain Features and Linear Discriminant Analysis.

The system of sEMG recognition for prosthetic hand control

Robust gesture recognition based on attention-deep fast convolutional neural network and surface electromyographic signals