Abstract:Gesture recognition, being a natural and convenient means of human-computer interaction, has emerged as a prominent area of research. The goal of accurate and swift gesture recognition has driven numerous studies, as it plays a crucial role in meeting practical application demands. Real-time monitoring of surface electromyography (sEMG) signals collected from sEMG sensor during gesture execution enables the extraction of rich gesture action features, prompting researchers to delve into sEMG-based gesture recognition algorithms. However, existing algorithms often struggle to strike a favorable balance between prediction accuracy and computational efficiency. In response to these challenges, this paper proposes a new gesture recognition model leveraging multi-channel sEMG signals captured by a sEMG sensor. The approach involves employing a lightweight convolutional neural network (CNN) model as the backbone network, supplemented by a lightweight feature extraction block (LFE) to effectively aggregate multi-scale features. Additionally, the model benefits from pre-training weights based on transfer learning, enhancing feature extraction capabilities and generalization ability for faster convergence of the prediction model. Moreover, the introduction of a plug-and-play block called the broad attention learning block (BAL) significantly improves the overall recognition performance of the proposed model. To better capture contextual information from multi-channel sEMG signals, a pyramid input with varying resolutions is constructed, elevating the model's multi-scale feature extraction capability. The proposed model is evaluated and validated on a dynamic gesture dataset collected using wearable sensor (Myo). A series of ablation experiments, comparative analyses, and visualization outcomes unequivocally showcase the remarkable efficacy and superiority of our proposed method. Comparisons with other advanced models reveal that the proposed model successfully achieves a balanced compromise between prediction accuracy and processing speed.

Sparse principle motion component for one-shot gesture recognition.

Research on Dynamic Gesture Recognition with Low-Pixel ToF-Sensors

A real-time hand gesture recognition method

Explore Efficient Local Features from RGB-D Data for One-Shot Learning Gesture Recognition

Feature learning based on SAE-PCA network for human gesture recognition in RGBD images.

Kernel-based Sparse Representation for Gesture Recognition

A wearable sensor-based dynamic gesture recognition model via broad attention learning

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

A Gesture Recognition Method Based On Spiking Neural Networks For Cognition Development

Gesture Recognition Using Enhanced Depth Motion Map and Static Pose Map

A Lightweight Hand-Gesture Recognition Network With Feature Fusion Prefiltering and FMCW Radar Spatial Angle Estimation

A Lightweight Hand-Gesture Recognition Network with Feature Fusion Pre-filtering and FMCW Radar Spatial Angle Estimation

Multi-layered Gesture Recognition with Kinect

Multimodal Spatiotemporal Feature Map for Dynamic Gesture Recognition

Principal component analysis of photoplethysmography signals for improved gesture recognition

Resource-Efficient Gesture Recognition using Low-Resolution Thermal Camera via Spiking Neural Networks and Sparse Segmentation

SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network

Position-independent gesture recognition using sEMG signals via canonical correlation analysis

Skeleton-Based Gesture Recognition Using Several Fully Connected Layers with Path Signature Features and Temporal Transformer Module.

Dynamic Gesture Recognition Method Based on Improved R(2+1)D