Abstract:Gesture recognition technology is widely used in the flexible and precise control of manipulators in the assisted medical field. Our MResLSTM algorithm can effectively perform dynamic gesture recognition. The result of surface EMG signal decoding is applied to the controller, which can improve the fluency of artificial hand control. Much current gesture recognition research using sEMG has focused on static gestures. In addition, the accuracy of recognition depends on the extraction and selection of features. However, Static gesture research cannot meet the requirements of natural human-computer interaction and dexterous control of manipulators. Therefore, a multi-stream residual network (MResLSTM) is proposed for dynamic hand movement recognition. This study aims to improve the accuracy and stability of dynamic gesture recognition. Simultaneously, it can also advance the research on the smooth control of the Manipulator. We combine the residual model and the convolutional short-term memory model into a unified framework. The architecture extracts spatiotemporal features from two aspects: global and deep, and combines feature fusion to retain essential information. The strategy of pointwise group convolution and channel shuffle is used to reduce the number of network calculations. A dataset is constructed containing six dynamic gestures for model training. The experimental results show that on the same recognition model, the gesture recognition effect of fusion of sEMG signal and acceleration signal is better than that of only using sEMG signal. The proposed approach obtains competitive performance on our dataset with the recognition accuracies of 93.52%, achieving state-of-the-art performance with 89.65% precision on the Ninapro DB1 dataset. Our bionic calculation method is applied to the controller, which can realize the continuity of human-computer interaction and the flexibility of manipulator control.

Dynamic Grasp Recognition Using Time Clustering, Gaussian Mixture Models and Hidden Markov Models

Dynamic hand gesture recognition using hidden Markov models

Mixed Hand Gesture Recognition System And Its Application

Hand Gesture Recognition in Complex Background Based on Convolutional Pose Machine and Fuzzy Gaussian Mixture Models

An interaction system using mixed hand gestures.

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

Intelligent Grasping with Natural Human-Robot Interaction.

Visual gesture recognition for human robot interaction using dynamic movement primitives

Hidden Markov models based dynamic hand gesture recognition with incremental learning method

A Dynamic Modelling Framework for Human Hand Gesture Task Recognition

A Real-time Hand Gesture Recognition Algorithm For an Embedded System

A Real Time Vision-Based Hand Gestures Recognition System

Inference of Upcoming Human Grasp Using EMG During Reach-to-Grasp Movement

Dynamic Hand Gesture Recognition Based on 3D Hand Pose Estimation for Human-Robot Interaction

Dynamic Hand Gesture-Featured Human Motor Adaptation in Tool Delivery using Voice Recognition

DYNAMIC HAND MOTION RECOGNITION BASED ON TRANSIENT AND STEADY-STATE EMG SIGNALS

Hidden States Exploration for 3D Skeleton-Based Gesture Recognition.

Dynamic Gesture Recognition Using Surface EMG Signals Based on Multi-Stream Residual Network

Towards Feasible Dynamic Grasping: Leveraging Gaussian Process Distance Field, SE(3) Equivariance and Riemannian Mixture Models

Grasp Type Understanding — Classification, Localization and Clustering

3D Skeletal Gesture Recognition Via Hidden States Exploration