Abstract:Gesture recognition technology is widely used in the flexible and precise control of manipulators in the assisted medical field. Our MResLSTM algorithm can effectively perform dynamic gesture recognition. The result of surface EMG signal decoding is applied to the controller, which can improve the fluency of artificial hand control. Much current gesture recognition research using sEMG has focused on static gestures. In addition, the accuracy of recognition depends on the extraction and selection of features. However, Static gesture research cannot meet the requirements of natural human-computer interaction and dexterous control of manipulators. Therefore, a multi-stream residual network (MResLSTM) is proposed for dynamic hand movement recognition. This study aims to improve the accuracy and stability of dynamic gesture recognition. Simultaneously, it can also advance the research on the smooth control of the Manipulator. We combine the residual model and the convolutional short-term memory model into a unified framework. The architecture extracts spatiotemporal features from two aspects: global and deep, and combines feature fusion to retain essential information. The strategy of pointwise group convolution and channel shuffle is used to reduce the number of network calculations. A dataset is constructed containing six dynamic gestures for model training. The experimental results show that on the same recognition model, the gesture recognition effect of fusion of sEMG signal and acceleration signal is better than that of only using sEMG signal. The proposed approach obtains competitive performance on our dataset with the recognition accuracies of 93.52%, achieving state-of-the-art performance with 89.65% precision on the Ninapro DB1 dataset. Our bionic calculation method is applied to the controller, which can realize the continuity of human-computer interaction and the flexibility of manipulator control.

Gesture recognition of data glove based on PSO-Improved BP neural network

Real-Time Continuous Gesture Recognition System Based on PSO-PNN

Interaction and control with the auxiliary of hand gesture

Dynamic Gesture Recognition Using Inertial Sensors-based Data Gloves.

A Convolutional-Transformer-Based Approach for Dynamic Gesture Recognition of Data Gloves

Gesture Recognition Based on BP Neural Network Improved by Chaotic Genetic Algorithm

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

Design of Human–Computer Interaction Gesture Tracking Model Based on Improved PSO and KCF Algorithms

Deep Learning Based Real-Time Recognition of Dynamic Finger Gestures Using a Data Glove

A gesture recognition system using Localist Attractor Networks for human-robot interaction

Recognition of Multi-scale Multi-angle Gestures Based on HOG-LBP Feature

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

A Novel Adaptive Mutation PSO Optimized SVM Algorithm for sEMG-Based Gesture Recognition

Multi-degree Prosthetic Hand Control Using a New BP Neural Network

Real-Time and Continuous Hand Gesture Spotting: an Approach Based on Artificial Neural Networks

Low‐Cost Data Glove Based on Deep‐Learning‐Enhanced Flexible Multiwalled Carbon Nanotube Sensors for Real‐Time Gesture Recognition

Dynamic Hand Gesture Recognition Based on 3D Hand Pose Estimation for Human-Robot Interaction

Real-time Vision-based Gesture Recognition for Human Robot Interaction

Hand Gesture Recognition using Deep Feature Fusion Network based on Wearable Sensors

Hand gesture recognition via deep data optimization and 3D reconstruction

Dynamic Gesture Recognition Using Surface EMG Signals Based on Multi-Stream Residual Network