Abstract:Gesture recognition using electromyography (EMG) signals has prevailed recently in the field of human–computer interactions for controlling intelligent prosthetics. Currently, machine learning and deep learning are the two most commonly employed methods for classifying hand gestures. Despite traditional machine learning methods already achieving impressive performance, it is still a huge amount of work to carry out feature extraction manually. The existing deep learning methods utilize complex neural network architectures to achieve higher accuracy, which will suffer from overfitting, insufficient adaptability, and low recognition accuracy. To improve the existing phenomenon, a novel lightweight model named dual stream LSTM feature fusion classifier is proposed based on the concatenation of five time-domain features of EMG signals and raw data, which are both processed with one-dimensional convolutional neural networks and LSTM layers to carry out the classification. The proposed method can effectively capture global features of EMG signals using a simple architecture, which means less computational cost. An experiment is conducted on a public DB1 dataset with 52 gestures, and each of the 27 subjects repeats every gesture 10 times. The accuracy rate achieved by the model is 89.66%, which is comparable to that achieved by more complex deep learning neural networks, and the inference time for each gesture is 87.6 ms, which can also be implied in a real-time control system. The proposed model is validated using a subject-wise experiment on 10 out of the 40 subjects in the DB2 dataset, achieving a mean accuracy of 91.74%. This is illustrated by its ability to fuse time-domain features and raw data to extract more effective information from the sEMG signal and select an appropriate, efficient, lightweight network to enhance the recognition results.

Touch Gesture Recognition Using Spatiotemporal Fusion Features

Improving Online Gesture Recognition with WarpingLCSS by Multi-Sensor Fusion

A real-time hand gesture recognition method

Research on Dynamic Gesture Recognition with Low-Pixel ToF-Sensors

3D Space Handwriting Recognition Based on Time-frequency Fusion Feature

Selective spatiotemporal features learning for dynamic gesture recognition

Hand Gesture Recognition using Deep Feature Fusion Network based on Wearable Sensors

A Novel Multi-Feature Fusion Network With Spatial Partitioning Strategy and Cross-Attention for Armband-Based Gesture Recognition

Fusion of kinematic and physiological sensors for hand gesture recognition

Multimodal Spatiotemporal Feature Map for Dynamic Gesture Recognition

Extraction of Spatial-Temporal Features for Vision-Based Gesture Recognition

A Convolutional-Transformer-Based Approach for Dynamic Gesture Recognition of Data Gloves

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

Feature Fusion for 3D Hand Gesture Recognition by Learning a Shared Hidden Space

A Lightweight Hand-Gesture Recognition Network With Feature Fusion Prefiltering and FMCW Radar Spatial Angle Estimation

Multimodal Gesture Recognition Based on Attention Slow-Fast Fusion Networks

TFN-FICFM: sEMG-Based Gesture Recognition Using Temporal Fusion Network and Fuzzy Integral-based Classifier Fusion

Dual Stream Long Short-Term Memory Feature Fusion Classifier for Surface Electromyography Gesture Recognition

Research and Application of Multifeature Gesture Recognition in Human-Computer Interaction Based on Virtual Reality Technology

Object Recognition Using Tactile and Image Information.

Learning Effective Spatial–Temporal Features for sEMG Armband-Based Gesture Recognition