Abstract:Gesture recognition technology is widely used in the flexible and precise control of manipulators in the assisted medical field. Our MResLSTM algorithm can effectively perform dynamic gesture recognition. The result of surface EMG signal decoding is applied to the controller, which can improve the fluency of artificial hand control. Much current gesture recognition research using sEMG has focused on static gestures. In addition, the accuracy of recognition depends on the extraction and selection of features. However, Static gesture research cannot meet the requirements of natural human-computer interaction and dexterous control of manipulators. Therefore, a multi-stream residual network (MResLSTM) is proposed for dynamic hand movement recognition. This study aims to improve the accuracy and stability of dynamic gesture recognition. Simultaneously, it can also advance the research on the smooth control of the Manipulator. We combine the residual model and the convolutional short-term memory model into a unified framework. The architecture extracts spatiotemporal features from two aspects: global and deep, and combines feature fusion to retain essential information. The strategy of pointwise group convolution and channel shuffle is used to reduce the number of network calculations. A dataset is constructed containing six dynamic gestures for model training. The experimental results show that on the same recognition model, the gesture recognition effect of fusion of sEMG signal and acceleration signal is better than that of only using sEMG signal. The proposed approach obtains competitive performance on our dataset with the recognition accuracies of 93.52%, achieving state-of-the-art performance with 89.65% precision on the Ninapro DB1 dataset. Our bionic calculation method is applied to the controller, which can realize the continuity of human-computer interaction and the flexibility of manipulator control.

A Teleoperated Manipulator Control System Based on Surface Electromyography Using Deep Learning

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Gesture recognition based on sEMG using multi-attention mechanism for remote control

Dynamic Gesture Recognition Using Surface EMG Signals Based on Multi-Stream Residual Network

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

Improved Network and Training Scheme for Cross-Trial Surface Electromyography (Semg)-Based Gesture Recognition.

Semi-Supervised Learning for Surface EMG-based Gesture Recognition.

Semg-Based Gesture Recognition with Embedded Virtual Hand Poses and Adversarial Learning.

A Control Scheme Based On EMG for Teleoperation Robot System

A Wearable and Portable Real-Time Control Gesture Recognition System for Bionic Manipulator

The system of sEMG recognition for prosthetic hand control

Complex Surface Electromyography Signal Gesture Recognition Based on Multipathway Featured Scale Convolutional Neural Network

Robotic telemanipulation with EMG-driven strategy-assisted shared control method

Surface Electromyography-Based Action Recognition and Manipulator Control

Surface Electromyography Signal Recognition Based on Deep Learning for Human-Robot Interaction and Collaboration

Semg-Based Gesture Recognition Using Deep Learning from Noisy Labels.

From Forearm to Wrist: Deep Learning for Surface Electromyography-Based Gesture Recognition.

Gesture Recognition Using Surface Electromyography and Deep Learning for Prostheses Hand: State-of-the-Art, Challenges, and Future

STCN-GR: Spatial-Temporal Convolutional Networks for Surface-Electromyography-Based Gesture Recognition

Gesture Recognition Through sEMG with Wearable Device Based on Deep Learning

Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method