Abstract:Human-computer interaction is a discipline that studies the interaction between computer systems and users. Nowadays, it has become an important research topic in the field of robotics, especially in the field of auxiliary robots. As gestures can express rich information, gesture recognition is widely used in machine control, smart home, etc. Vision-based gesture recognition systems can greatly facilitate the lives of the elderly, the sick and the disabled. However, it is also a challenging task to compress the model while maintaining its accuracy in order to achieve efficient recognition on some inexpensive hardware configurations with limited resources. To this end, a lightweight gesture recognition based on an improved gated recurrent unit (GRU) for skeleton dynamic graphs is proposed in this paper. Firstly, the gesture skeleton data is preprocessed, and the coordinates of key joints are selected as input. Then, the mapped gesture feature data is cut to an appropriate size based on an adjustment and clipping module, and then input into an improved GRU for feature learning, which strengthens the ability of the GRU network to learn spatial features, so as to achieve efficient extraction of temporal and spatial features. Finally, the prediction result is output by the classifier. The extensive experiments are conducted on the public datasets DHG14/28 and SHREC’17. In terms of the model size or number of parameters, the proposed model can get the state-of-the-art performance. The average size of the proposed model decreases by more than 30% compared with the general GRU network. Furthermore, the proposed model can get a competitive accuracy performance of 92.13% and 93.98%, on the dataset DHG14/28 and SHREC’17, respectively. It is proved that our model is a lightweight and efficient model for gesture recognition of skeleton dynamic graphs.

An Efficient Graph Convolution Network for Skeleton-Based Dynamic Hand Gesture Recognition

Spatial Temporal Graph Convolutional Networks for Skeleton-Based Dynamic Hand Gesture Recognition

Spatio-Temporal Dynamic Attention Graph Convolutional Network Based on Skeleton Gesture Recognition

Skeleton-Based Gesture Recognition With Learnable Paths and Signature Features

A lightweight GRU-based gesture recognition model for skeleton dynamic graphs

A Spatio-Temporal Graph Convolutional Network for Gesture Recognition from High-Density Electromyography

Human gesture recognition of dynamic skeleton using graph convolutional networks

Spatial-Temporal Attention Res-TCN for Skeleton-Based Dynamic Hand Gesture Recognition

Adaptive Graph Residual Network for Hand Shape Estimation in Single Images

Temporal Decoupling Graph Convolutional Network for Skeleton-Based Gesture Recognition

Dynamic Semantic-Based Spatial-Temporal Graph Convolution Network for Skeleton-Based Human Action Recognition

Recognizing Skeleton-Based Hand Gestures by a Spatio-Temporal Network

Skeleton-Based Gesture Recognition Using Several Fully Connected Layers with Path Signature Features and Temporal Transformer Module.

STCN-GR: Spatial-Temporal Convolutional Networks for Surface-Electromyography-Based Gesture Recognition

Hand-Aware Graph Convolution Network for Skeleton-Based Sign Language Recognition

HAN: An Efficient Hierarchical Self-Attention Network for Skeleton-Based Gesture Recognition

Angle based hand gesture recognition using graph convolutional network

A Local Spatial–Temporal Synchronous Network to Dynamic Gesture Recognition

Gesture Recognition Matching Based on Dynamic Skeleton

Skeleton-Based Action Recognition with Improved Graph Convolution Network

Decoupled Representation Learning for Skeleton-Based Gesture Recognition