Abstract:Human-computer interaction is a discipline that studies the interaction between computer systems and users. Nowadays, it has become an important research topic in the field of robotics, especially in the field of auxiliary robots. As gestures can express rich information, gesture recognition is widely used in machine control, smart home, etc. Vision-based gesture recognition systems can greatly facilitate the lives of the elderly, the sick and the disabled. However, it is also a challenging task to compress the model while maintaining its accuracy in order to achieve efficient recognition on some inexpensive hardware configurations with limited resources. To this end, a lightweight gesture recognition based on an improved gated recurrent unit (GRU) for skeleton dynamic graphs is proposed in this paper. Firstly, the gesture skeleton data is preprocessed, and the coordinates of key joints are selected as input. Then, the mapped gesture feature data is cut to an appropriate size based on an adjustment and clipping module, and then input into an improved GRU for feature learning, which strengthens the ability of the GRU network to learn spatial features, so as to achieve efficient extraction of temporal and spatial features. Finally, the prediction result is output by the classifier. The extensive experiments are conducted on the public datasets DHG14/28 and SHREC’17. In terms of the model size or number of parameters, the proposed model can get the state-of-the-art performance. The average size of the proposed model decreases by more than 30% compared with the general GRU network. Furthermore, the proposed model can get a competitive accuracy performance of 92.13% and 93.98%, on the dataset DHG14/28 and SHREC’17, respectively. It is proved that our model is a lightweight and efficient model for gesture recognition of skeleton dynamic graphs.

Angle based hand gesture recognition using graph convolutional network

Dynamic Hand Gesture Recognition Using Multi-Branch Attention Based Graph and General Deep Learning Model

MVHANet: Multi-view Hierarchical Aggregation Network for Skeleton-Based Hand Gesture Recognition

An Efficient Graph Convolution Network for Skeleton-Based Dynamic Hand Gesture Recognition

Spatio-Temporal Dynamic Attention Graph Convolutional Network Based on Skeleton Gesture Recognition

Human gesture recognition of dynamic skeleton using graph convolutional networks

A Spatio-Temporal Graph Convolutional Network for Gesture Recognition from High-Density Electromyography

Skeleton-Based Gesture Recognition With Learnable Paths and Signature Features

A lightweight GRU-based gesture recognition model for skeleton dynamic graphs

Temporal Decoupling Graph Convolutional Network for Skeleton-Based Gesture Recognition

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

An accurate estimation of hand gestures using optimal modified convolutional neural network

Normalized Edge Convolutional Networks for Skeleton-Based Hand Gesture Recognition

Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Recurrent Neural Network

HAN: An Efficient Hierarchical Self-Attention Network for Skeleton-Based Gesture Recognition

Adaptive Graph Residual Network for Hand Shape Estimation in Single Images

MFA-Net: Motion Feature Augmented Network for Dynamic Hand Gesture Recognition from Skeletal Data

Recognition of Hand Gesture Image Using Deep Convolutional Neural Network

Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition

Attention adjacency matrix based graph convolutional networks for skeleton-based action recognition

A novel hand gesture detection and recognition system based on ensemble-based convolutional neural network