Abstract:Gesture recognition, being a natural and convenient means of human-computer interaction, has emerged as a prominent area of research. The goal of accurate and swift gesture recognition has driven numerous studies, as it plays a crucial role in meeting practical application demands. Real-time monitoring of surface electromyography (sEMG) signals collected from sEMG sensor during gesture execution enables the extraction of rich gesture action features, prompting researchers to delve into sEMG-based gesture recognition algorithms. However, existing algorithms often struggle to strike a favorable balance between prediction accuracy and computational efficiency. In response to these challenges, this paper proposes a new gesture recognition model leveraging multi-channel sEMG signals captured by a sEMG sensor. The approach involves employing a lightweight convolutional neural network (CNN) model as the backbone network, supplemented by a lightweight feature extraction block (LFE) to effectively aggregate multi-scale features. Additionally, the model benefits from pre-training weights based on transfer learning, enhancing feature extraction capabilities and generalization ability for faster convergence of the prediction model. Moreover, the introduction of a plug-and-play block called the broad attention learning block (BAL) significantly improves the overall recognition performance of the proposed model. To better capture contextual information from multi-channel sEMG signals, a pyramid input with varying resolutions is constructed, elevating the model's multi-scale feature extraction capability. The proposed model is evaluated and validated on a dynamic gesture dataset collected using wearable sensor (Myo). A series of ablation experiments, comparative analyses, and visualization outcomes unequivocally showcase the remarkable efficacy and superiority of our proposed method. Comparisons with other advanced models reveal that the proposed model successfully achieves a balanced compromise between prediction accuracy and processing speed.

An Energy-Efficient BNN Accelerator with Two-Stage Value Prediction for Sparse-Edge Gesture Recognition

BitSNNs: Revisiting Energy-efficient Spiking Neural Networks

High-speed Low-consumption sEMG-based Transient-state micro-Gesture Recognition

Energy-Efficient Spiking Recurrent Neural Network for Gesture Recognition on Embedded GPUs

SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network

A Sparsity-Adapted Hardware Implementation of SNN for Cortical Spike Trains Decoding

A wearable sensor-based dynamic gesture recognition model via broad attention learning

sEMG-Based Hand Gesture Recognition Using Binarized Neural Network

Reducing the Energy Consumption of sEMG-Based Gesture Recognition at the Edge Using Transformers and Dynamic Inference

Real-Time Multiple Gesture Recognition: Application of a Lightweight Individualized 1D CNN Model to an Edge Computing System

NBSSN: A Neuromorphic Binary Single-Spike Neural Network for Efficient Edge Intelligence.

TinyRadarNN: Combining Spatial and Temporal Convolutional Neural Networks for Embedded Gesture Recognition with Short Range Radars

Neuromorphic Edge Computing for Biomedical Applications: Gesture Classification Using EMG Signals

Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition

A 67.5μJ/Prediction Accelerator for Spiking Neural Networks in Image Segmentation

A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition

NIMBLE: A Neuromorphic Learning Scheme and Memristor Based Computing-in-Memory Engine for EMG Based Hand Gesture Recognition.

Resource-Efficient Gesture Recognition using Low-Resolution Thermal Camera via Spiking Neural Networks and Sparse Segmentation

Efficient Gesture Recognition on Spiking Convolutional Networks Through Sensor Fusion of Event-Based and Depth Data

FPGA-based Lightweight QDS-CNN System for sEMG Gesture and Force Level Recognition