Abstract:Gesture recognition, being a natural and convenient means of human-computer interaction, has emerged as a prominent area of research. The goal of accurate and swift gesture recognition has driven numerous studies, as it plays a crucial role in meeting practical application demands. Real-time monitoring of surface electromyography (sEMG) signals collected from sEMG sensor during gesture execution enables the extraction of rich gesture action features, prompting researchers to delve into sEMG-based gesture recognition algorithms. However, existing algorithms often struggle to strike a favorable balance between prediction accuracy and computational efficiency. In response to these challenges, this paper proposes a new gesture recognition model leveraging multi-channel sEMG signals captured by a sEMG sensor. The approach involves employing a lightweight convolutional neural network (CNN) model as the backbone network, supplemented by a lightweight feature extraction block (LFE) to effectively aggregate multi-scale features. Additionally, the model benefits from pre-training weights based on transfer learning, enhancing feature extraction capabilities and generalization ability for faster convergence of the prediction model. Moreover, the introduction of a plug-and-play block called the broad attention learning block (BAL) significantly improves the overall recognition performance of the proposed model. To better capture contextual information from multi-channel sEMG signals, a pyramid input with varying resolutions is constructed, elevating the model's multi-scale feature extraction capability. The proposed model is evaluated and validated on a dynamic gesture dataset collected using wearable sensor (Myo). A series of ablation experiments, comparative analyses, and visualization outcomes unequivocally showcase the remarkable efficacy and superiority of our proposed method. Comparisons with other advanced models reveal that the proposed model successfully achieves a balanced compromise between prediction accuracy and processing speed.

AutoGesNet: Auto Gesture Recognition Network Based on Neural Architecture Search

Deep Learning Based Hand Gesture Recognition in Complex Scenes

Searching Multi-Rate and Multi-Modal Temporal Enhanced Networks for Gesture Recognition

Integrated block-wise neural network with auto-learning search framework for finger gesture recognition using sEMG signals

AL-MobileNet: a Novel Model for 2D Gesture Recognition in Intelligent Cockpit Based on Multi-Modal Data

FGDSNet: A Lightweight Hand Gesture Recognition Network for Human Robot Interaction

Recognition of Hand Gesture Image Using Deep Convolutional Neural Network

Multimode Gesture Recognition Algorithm Based on Convolutional Long Short-Term Memory Network

Gesture recognition based on deep deformable 3D convolutional neural networks

Visual Hand Gesture Recognition With Convolution Neural Network

Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method

Auto-FERNet: A Facial Expression Recognition Network With Architecture Search

An Evolutionary Network Architecture Search Framework with Adaptive Multimodal Fusion for Hand Gesture Recognition

A ConvNet Structure Learning Spatiotemporal Features for Gesture Recognition

A Hybrid CNN-LSTM Network for Hand Gesture Recognition with Surface EMG Signals

A wearable sensor-based dynamic gesture recognition model via broad attention learning

A Two-stream Neural Network for Pose-based Hand Gesture Recognition

Large-scale Isolated Gesture Recognition Using Convolutional Neural Networks

Multi-Scale Attention 3D Convolutional Network for Multimodal Gesture Recognition

Dynamic Gesture Recognition Algorithm Based on 3D Convolutional Neural Network

Gesture Recognition Algorithm of Human Motion Target Based on Deep Neural Network