Abstract:Gesture recognition, being a natural and convenient means of human-computer interaction, has emerged as a prominent area of research. The goal of accurate and swift gesture recognition has driven numerous studies, as it plays a crucial role in meeting practical application demands. Real-time monitoring of surface electromyography (sEMG) signals collected from sEMG sensor during gesture execution enables the extraction of rich gesture action features, prompting researchers to delve into sEMG-based gesture recognition algorithms. However, existing algorithms often struggle to strike a favorable balance between prediction accuracy and computational efficiency. In response to these challenges, this paper proposes a new gesture recognition model leveraging multi-channel sEMG signals captured by a sEMG sensor. The approach involves employing a lightweight convolutional neural network (CNN) model as the backbone network, supplemented by a lightweight feature extraction block (LFE) to effectively aggregate multi-scale features. Additionally, the model benefits from pre-training weights based on transfer learning, enhancing feature extraction capabilities and generalization ability for faster convergence of the prediction model. Moreover, the introduction of a plug-and-play block called the broad attention learning block (BAL) significantly improves the overall recognition performance of the proposed model. To better capture contextual information from multi-channel sEMG signals, a pyramid input with varying resolutions is constructed, elevating the model's multi-scale feature extraction capability. The proposed model is evaluated and validated on a dynamic gesture dataset collected using wearable sensor (Myo). A series of ablation experiments, comparative analyses, and visualization outcomes unequivocally showcase the remarkable efficacy and superiority of our proposed method. Comparisons with other advanced models reveal that the proposed model successfully achieves a balanced compromise between prediction accuracy and processing speed.

Dynamic hand gesture early recognition based on Hidden Semi-Markov Models

Dynamic hand gesture recognition using hidden Markov models

A real-time hand gesture recognition method

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

A Real Time Vision-Based Hand Gestures Recognition System

An interaction system using mixed hand gestures.

Hidden States Exploration for 3D Skeleton-Based Gesture Recognition.

Hidden Markov models based dynamic hand gesture recognition with incremental learning method

Dynamic Gesture Recognition based on LeapMotion and HMM-CART Model

Semg-Based Gesture Recognition with Embedded Virtual Hand Poses and Adversarial Learning.

3D Skeletal Gesture Recognition Via Hidden States Exploration

Semi-Supervised Learning for Surface EMG-based Gesture Recognition.

Mixed Hand Gesture Recognition System And Its Application

Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors

Dynamic Gesture Recognition Using Inertial Sensors-based Data Gloves.

A wearable sensor-based dynamic gesture recognition model via broad attention learning

Non-intrusive gesture recognition system combining with face detection based on Hidden Markov Model

Dynamic Gesture Recognition Using Surface EMG Signals Based on Multi-Stream Residual Network

Hand gesture based control with multi-modality data - towards surgical applications

A Real-Time Computer Vision-Based Static and Dynamic Hand Gesture Recognition System

Visual gesture recognition for human robot interaction using dynamic movement primitives