Abstract:Gesture recognition, being a natural and convenient means of human-computer interaction, has emerged as a prominent area of research. The goal of accurate and swift gesture recognition has driven numerous studies, as it plays a crucial role in meeting practical application demands. Real-time monitoring of surface electromyography (sEMG) signals collected from sEMG sensor during gesture execution enables the extraction of rich gesture action features, prompting researchers to delve into sEMG-based gesture recognition algorithms. However, existing algorithms often struggle to strike a favorable balance between prediction accuracy and computational efficiency. In response to these challenges, this paper proposes a new gesture recognition model leveraging multi-channel sEMG signals captured by a sEMG sensor. The approach involves employing a lightweight convolutional neural network (CNN) model as the backbone network, supplemented by a lightweight feature extraction block (LFE) to effectively aggregate multi-scale features. Additionally, the model benefits from pre-training weights based on transfer learning, enhancing feature extraction capabilities and generalization ability for faster convergence of the prediction model. Moreover, the introduction of a plug-and-play block called the broad attention learning block (BAL) significantly improves the overall recognition performance of the proposed model. To better capture contextual information from multi-channel sEMG signals, a pyramid input with varying resolutions is constructed, elevating the model's multi-scale feature extraction capability. The proposed model is evaluated and validated on a dynamic gesture dataset collected using wearable sensor (Myo). A series of ablation experiments, comparative analyses, and visualization outcomes unequivocally showcase the remarkable efficacy and superiority of our proposed method. Comparisons with other advanced models reveal that the proposed model successfully achieves a balanced compromise between prediction accuracy and processing speed.

Exploration on the Negative Effects of Sensor Shifts in Photoplethysmography-based Gesture Recognition and a Solution based on Transfer Learning

Improving Online Gesture Recognition with WarpingLCSS by Multi-Sensor Fusion

Research on Dynamic Gesture Recognition with Low-Pixel ToF-Sensors

RGC: Reliable Gesture Classification Via Wearables Using GANs-Based Data Augmentation.

Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method

Fusion of kinematic and physiological sensors for hand gesture recognition

Comparative Study of Gesture Recognition Based on Accelerometer and Photoplethysmography Sensor for Gesture Interactions in Wearable Devices

Hand Gesture Recognition using Deep Feature Fusion Network based on Wearable Sensors

An adaptive learning method for long-term gesture recognition based on surface electromyography

Cross-user gesture recognition from sEMG signals using an optimal transport assisted student-teacher framework

Dual Layer Transfer Learning for Semg-Based User-Independent Gesture Recognition

Improved Network and Training Scheme for Cross-Trial Surface Electromyography (Semg)-Based Gesture Recognition.

A wearable sensor-based dynamic gesture recognition model via broad attention learning

EMG-based Multi-User Hand Gesture Classification via Unsupervised Transfer Learning Using Unknown Calibration Gestures

A Convolutional-Transformer-Based Approach for Dynamic Gesture Recognition of Data Gloves

Attentive 3D-Ghost Module for Dynamic Hand Gesture Recognition with Positive Knowledge Transfer

A Wearable Gesture Recognition System with Ultra-high Accuracy and Robustness Enabled by the Synergy of Multiple Fabric Sensing Devices

Cross-Individual Gesture Recognition Based on Long Short-Term Memory Networks

Principal component analysis of photoplethysmography signals for improved gesture recognition

Design and Implementation of Gesture Recognition System Based on Flex Sensors

Online cross session electromyographic hand gesture recognition using deep learning and transfer learning