Abstract:Gesture recognition, being a natural and convenient means of human-computer interaction, has emerged as a prominent area of research. The goal of accurate and swift gesture recognition has driven numerous studies, as it plays a crucial role in meeting practical application demands. Real-time monitoring of surface electromyography (sEMG) signals collected from sEMG sensor during gesture execution enables the extraction of rich gesture action features, prompting researchers to delve into sEMG-based gesture recognition algorithms. However, existing algorithms often struggle to strike a favorable balance between prediction accuracy and computational efficiency. In response to these challenges, this paper proposes a new gesture recognition model leveraging multi-channel sEMG signals captured by a sEMG sensor. The approach involves employing a lightweight convolutional neural network (CNN) model as the backbone network, supplemented by a lightweight feature extraction block (LFE) to effectively aggregate multi-scale features. Additionally, the model benefits from pre-training weights based on transfer learning, enhancing feature extraction capabilities and generalization ability for faster convergence of the prediction model. Moreover, the introduction of a plug-and-play block called the broad attention learning block (BAL) significantly improves the overall recognition performance of the proposed model. To better capture contextual information from multi-channel sEMG signals, a pyramid input with varying resolutions is constructed, elevating the model's multi-scale feature extraction capability. The proposed model is evaluated and validated on a dynamic gesture dataset collected using wearable sensor (Myo). A series of ablation experiments, comparative analyses, and visualization outcomes unequivocally showcase the remarkable efficacy and superiority of our proposed method. Comparisons with other advanced models reveal that the proposed model successfully achieves a balanced compromise between prediction accuracy and processing speed.

Towards End-to-End Gesture Recognition with Recurrent Neural Networks

Gesture Recognition Method Based On Deep Learning

Egocentric Gesture Recognition Using Recurrent 3D Convolutional Neural Networks with Spatiotemporal Transformer Modules

A Gesture Recognition Method Based On Spiking Neural Networks For Cognition Development

Raw sEMG-based Real-time Gesture Recognition with Recurrent Neural Networks

Dynamic Gesture Recognition Based on RF Sensor and AE-LSTM Neural Network

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

Motion Feature Augmented Recurrent Neural Network for Skeleton-based Dynamic Hand Gesture Recognition

Realtime Recognition of Dynamic Hand Gestures in Practical Applications

Gesture Recognition Based on Deep Learning: A Review

Temporal Convolutional Neural Network for Gesture Recognition.

Motion-Pose Recurrent Neural Network With Instantaneous Kinematic Descriptor For Skeleton Based Gesture Detection And Recognition

A wearable sensor-based dynamic gesture recognition model via broad attention learning

Multimodal Spatiotemporal Feature Map for Dynamic Gesture Recognition

A Novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural Network

Gesture Recognition Algorithm of Human Motion Target Based on Deep Neural Network

A New Spiking Convolutional Recurrent Neural Network (SCRNN) With Applications to Event-Based Hand Gesture Recognition

A Comparison of Bidirectional GRU and LSTM for Hand Gesture Recognition Using Leap Motion

Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Recurrent Neural Network

Gesture Recognition System Based on Neural Networks by Using COTS RFID Tag Array.

A Comprehensive Evaluation of Moving Static Gesture Recognition with Convolutional Networks