Abstract:Gestures have been used for nonverbal communication for a long time, but human-computer interaction (HCI) via gestures is becoming more common in the modern era. To obtain a greater recognition rate, the traditional interface comprises various devices, such as gloves, physical controllers, and markers. This study provides a new markerless technique for obtaining gestures without the need for any barriers or pricey hardware. In this paper, dynamic gestures are first converted into frames. The noise is removed, and intensity is adjusted for feature extraction. The hand gesture is first detected through the images, and the skeleton is computed through mathematical computations. From the skeleton, the features are extracted; these features include joint color cloud, neural gas, and directional active model. After that, the features are optimized, and a selective feature set is passed through the classifier recurrent neural network (RNN) to obtain the classification results with higher accuracy. The proposed model is experimentally assessed and trained over three datasets: HaGRI, Egogesture, and Jester. The experimental results for the three datasets provided improved results based on classification, and the proposed system achieved an accuracy of 92.57% over HaGRI, 91.86% over Egogesture, and 91.57% over the Jester dataset, respectively. Also, to check the model liability, the proposed method was tested on the WLASL dataset, attaining 90.43% accuracy. This paper also includes a comparison with other-state-of-the art methods to compare our model with the standard methods of recognition. Our model presented a higher accuracy rate with a markerless approach to save money and time for classifying the gestures for better interaction.

A Fast-Response Dynamic-Static Parallel Attention GCN Network for Body–Hand Gesture Recognition in HRI

Egocentric Gesture Recognition Using Recurrent 3D Convolutional Neural Networks with Spatiotemporal Transformer Modules

A Spatio-Temporal Graph Convolutional Network for Gesture Recognition from High-Density Electromyography

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Spatio-Temporal Dynamic Attention Graph Convolutional Network Based on Skeleton Gesture Recognition

Dynamic Gesture Recognition by Directional Pulse Coupled Neural Networks for Human-Robot Interaction in Real Time.

Dynamic Hand Gesture Recognition Based on 3D Hand Pose Estimation for Human-Robot Interaction

Predictive Hand Gesture Classification for Real Time Robot Control.

A Deep Learning Framework for Recognizing both Static and Dynamic Gestures

Skeleton Guided Conflict-Free Hand Gesture Recognition for Robot Control.

Short-Term Temporal Convolutional Networks for Dynamic Hand Gesture Recognition

Dyadic relational graph convolutional networks for skeleton-based human interaction recognition

Skeleton Based Dynamic Hand Gesture Recognition using Short Term Sampling Neural Networks (STSNN).

Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Recurrent Neural Network

An Efficient Graph Convolution Network for Skeleton-Based Dynamic Hand Gesture Recognition

Real-Time Multi-modal Human-Robot Collaboration Using Gestures and Speech

A Two-stream Neural Network for Pose-based Hand Gesture Recognition

FGDSNet: A Lightweight Hand Gesture Recognition Network for Human Robot Interaction

A Dynamic Head Gesture Recognition Method for Real-time Intention Inference and Its Application to Visual Human-robot Interaction

Multi-Scale Attention 3D Convolutional Network for Multimodal Gesture Recognition

Multimodal Gesture Recognition Based on Attention Slow-Fast Fusion Networks