Abstract:Gesture recognition technology is widely used in the flexible and precise control of manipulators in the assisted medical field. Our MResLSTM algorithm can effectively perform dynamic gesture recognition. The result of surface EMG signal decoding is applied to the controller, which can improve the fluency of artificial hand control. Much current gesture recognition research using sEMG has focused on static gestures. In addition, the accuracy of recognition depends on the extraction and selection of features. However, Static gesture research cannot meet the requirements of natural human-computer interaction and dexterous control of manipulators. Therefore, a multi-stream residual network (MResLSTM) is proposed for dynamic hand movement recognition. This study aims to improve the accuracy and stability of dynamic gesture recognition. Simultaneously, it can also advance the research on the smooth control of the Manipulator. We combine the residual model and the convolutional short-term memory model into a unified framework. The architecture extracts spatiotemporal features from two aspects: global and deep, and combines feature fusion to retain essential information. The strategy of pointwise group convolution and channel shuffle is used to reduce the number of network calculations. A dataset is constructed containing six dynamic gestures for model training. The experimental results show that on the same recognition model, the gesture recognition effect of fusion of sEMG signal and acceleration signal is better than that of only using sEMG signal. The proposed approach obtains competitive performance on our dataset with the recognition accuracies of 93.52%, achieving state-of-the-art performance with 89.65% precision on the Ninapro DB1 dataset. Our bionic calculation method is applied to the controller, which can realize the continuity of human-computer interaction and the flexibility of manipulator control.

Multi-Touch Gesture Recognition Based on Petri Net and Back Propagation Neural Networks

A RD-T Network for Hand Gesture Recognition Based on Millimeter-Wave Sensor

A Gesture Recognition Method Based On Spiking Neural Networks For Cognition Development

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

A gesture recognition system using Localist Attractor Networks for human-robot interaction

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

Searching Multi-Rate and Multi-Modal Temporal Enhanced Networks for Gesture Recognition

Multimodal Spatiotemporal Feature Map for Dynamic Gesture Recognition

Multimodal Gesture Recognition Using Multi-stream Recurrent Neural Network

Mixed Hand Gesture Recognition System And Its Application

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Study on Gesture Recognition Method with Two-Stream Residual Network Fusing sEMG Signals and Acceleration Signals

Dynamic gesture tracking and recognition algorithm based on deep learning

Multi-Task and Multi-Modal Learning for RGB Dynamic Gesture Recognition

Multi-modal fusion for robust hand gesture recognition based on heterogeneous networks

Real-Time Continuous Gesture Recognition System Based on PSO-PNN

Dynamic Gesture Recognition Using Surface EMG Signals Based on Multi-Stream Residual Network

A Deep Learning Framework for Recognizing both Static and Dynamic Gestures

Multi-degree Prosthetic Hand Control Using a New BP Neural Network

Millimeter wave gesture recognition using multi-feature fusion models in complex scenes

Recognition of Multi-scale Multi-angle Gestures Based on HOG-LBP Feature