Abstract:Gesture recognition, being a natural and convenient means of human-computer interaction, has emerged as a prominent area of research. The goal of accurate and swift gesture recognition has driven numerous studies, as it plays a crucial role in meeting practical application demands. Real-time monitoring of surface electromyography (sEMG) signals collected from sEMG sensor during gesture execution enables the extraction of rich gesture action features, prompting researchers to delve into sEMG-based gesture recognition algorithms. However, existing algorithms often struggle to strike a favorable balance between prediction accuracy and computational efficiency. In response to these challenges, this paper proposes a new gesture recognition model leveraging multi-channel sEMG signals captured by a sEMG sensor. The approach involves employing a lightweight convolutional neural network (CNN) model as the backbone network, supplemented by a lightweight feature extraction block (LFE) to effectively aggregate multi-scale features. Additionally, the model benefits from pre-training weights based on transfer learning, enhancing feature extraction capabilities and generalization ability for faster convergence of the prediction model. Moreover, the introduction of a plug-and-play block called the broad attention learning block (BAL) significantly improves the overall recognition performance of the proposed model. To better capture contextual information from multi-channel sEMG signals, a pyramid input with varying resolutions is constructed, elevating the model's multi-scale feature extraction capability. The proposed model is evaluated and validated on a dynamic gesture dataset collected using wearable sensor (Myo). A series of ablation experiments, comparative analyses, and visualization outcomes unequivocally showcase the remarkable efficacy and superiority of our proposed method. Comparisons with other advanced models reveal that the proposed model successfully achieves a balanced compromise between prediction accuracy and processing speed.

A Hybrid Model Based on ResNet and GCN for sEMG-Based Gesture Recognition

Gesture recognition based on surface electromyography‐feature image

A Hybrid CNN-LSTM Network for Hand Gesture Recognition with Surface EMG Signals

Improved Network and Training Scheme for Cross-Trial Surface Electromyography (Semg)-Based Gesture Recognition.

A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition

Semg-Based Gesture Recognition with Embedded Virtual Hand Poses and Adversarial Learning.

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Semi-Supervised Learning for Surface EMG-based Gesture Recognition.

A Global and Local Feature fused CNN architecture for the sEMG-based hand gesture recognition

Integration of Convolutional Neural Network and Vision Transformer for Gesture Recognition Using Semg

STCN-GR: Spatial-Temporal Convolutional Networks for Surface-Electromyography-Based Gesture Recognition

A multi-stream convolutional neural network for sEMG-based gesture recognition in muscle-computer interface

Gesture recognition by instantaneous surface EMG images

sEMG-Based Gesture Recognition with Convolution Neural Networks

Study on Gesture Recognition Method with Two-Stream Residual Network Fusing sEMG Signals and Acceleration Signals

A wearable sensor-based dynamic gesture recognition model via broad attention learning

Research on gesture recognition method based on SEDCNN-SVM

Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method

A Multimodal Multilevel Converged Attention Network for Hand Gesture Recognition With Hybrid sEMG and A-Mode Ultrasound Sensing

TCNN-KAN: Optimized CNN by Kolmogorov-Arnold Network and Pruning Techniques for sEMG Gesture Recognition