Abstract:Hand gesture recognition based on sparse multichannel surface electromyography (sEMG) still poses a significant challenge to deployment as a muscle–computer interface. Many researchers have been working to develop an sEMG-based hand gesture recognition system. However, the existing system still faces challenges in achieving satisfactory performance due to ineffective feature enhancement, so the prediction is erratic and unstable. To comprehensively tackle these challenges, we introduce a novel approach: a lightweight sEMG-based hand gesture recognition system using a 4-stream deep learning architecture. Each stream strategically combines Temporal Convolutional Network (TCN)-based time-varying features with Convolutional Neural Network (CNN)-based frame-wise features. In the first stream, we harness the power of the TCN module to extract nuanced time-varying temporal features. The second stream integrates a hybrid Long short-term memory (LSTM)-TCN module. This stream extracts temporal features using LSTM and seamlessly enhances them with TCN to effectively capture intricate long-range temporal relations. The third stream adopts a spatio-temporal strategy, merging the CNN and TCN modules. This integration facilitates concurrent comprehension of both spatial and temporal features, enriching the model's understanding of the underlying dynamics of the data. The fourth stream uses a skip connection mechanism to alleviate potential problems of data loss, ensuring a robust information flow throughout the network and concatenating the 4 stream features, yielding a comprehensive and effective final feature representation. We employ a channel attention-based feature selection module to select the most effective features, aiming to reduce the computational complexity and feed them into the classification module. The proposed model achieves an average accuracy of 94.31% and 98.96% on the Ninapro DB1 and DB9 datasets, respectively. This high-performance accuracy proves the superiority of the proposed model, and its implications extend to enhancing the quality of life for individuals using prosthetic limbs and advancing control systems in the field of robotic human–machine interfaces.

A Semg-Based Hand Motions Recognition System with Dimension-Reduced FFT

The system of sEMG recognition for prosthetic hand control

A Multichannel Surface EMG System for Hand Motion Recognition

Recognition Of Ten Upper Limb Movements Based On Surface Electromyography Signals

Application of a sEMG hand motion recognition method based on variational mode decomposition and ReliefF algorithm in rehabilitation medicine

Multiple Hand Gesture Recognition Based on Surface EMG Signal

Recognition System of Finger Movement Pattern Based on Semg

Real time motion intention recognition method with limited number of surface electromyography sensors for A 7-DOF hand/wrist rehabilitation exoskeleton

A New Approach for Hand Gesture Recognition Based on the Fusion of sEMG and Impedance Information

A Novel Method for Hand Movement Recognition Based on Wavelet Packet Transform and Principal Component Analysis with Surface Electromyogram

Hand gesture recognition using sEMG signals with a multi-stream time-varying feature enhancement approach

Measuring Motor Unit Discharge, Myofiber Vibration, and Haemodynamics for Enhanced Myoelectric Gesture Recognition.

A machine learning approach to identify hand actions from single-channel sEMG signals

A Neuro–Fuzzy Inference System for sEMG-Based Identification of Hand Motion Commands

Multi-user motion recognition using sEMG via discriminative canonical correlation analysis and adaptive dimensionality reduction

Hand Gestures Recognition from Multi-channel Forearm EMG Signals.

Semg Based Control for 5 DOF Upper Limb Rehabilitation Robot System

How to use one surface electromyography sensor to recognize six hand movements for a mechanical hand in real time: a method based on Morse code

Hand Movement Detection from Surface Electromyography Signals by Machine Learning Techniques

A Continuous Control Scheme for Multifunctional Robotic Arm with Surface EMG Signal

Hand Gesture Recognition Based on High-Density Myoelectricity in Forearm Flexors in Humans