Abstract:Gestures have been used for nonverbal communication for a long time, but human-computer interaction (HCI) via gestures is becoming more common in the modern era. To obtain a greater recognition rate, the traditional interface comprises various devices, such as gloves, physical controllers, and markers. This study provides a new markerless technique for obtaining gestures without the need for any barriers or pricey hardware. In this paper, dynamic gestures are first converted into frames. The noise is removed, and intensity is adjusted for feature extraction. The hand gesture is first detected through the images, and the skeleton is computed through mathematical computations. From the skeleton, the features are extracted; these features include joint color cloud, neural gas, and directional active model. After that, the features are optimized, and a selective feature set is passed through the classifier recurrent neural network (RNN) to obtain the classification results with higher accuracy. The proposed model is experimentally assessed and trained over three datasets: HaGRI, Egogesture, and Jester. The experimental results for the three datasets provided improved results based on classification, and the proposed system achieved an accuracy of 92.57% over HaGRI, 91.86% over Egogesture, and 91.57% over the Jester dataset, respectively. Also, to check the model liability, the proposed method was tested on the WLASL dataset, attaining 90.43% accuracy. This paper also includes a comparison with other-state-of-the art methods to compare our model with the standard methods of recognition. Our model presented a higher accuracy rate with a markerless approach to save money and time for classifying the gestures for better interaction.

Visual Hand Gesture Recognition With Convolution Neural Network

Deep Learning Based Hand Gesture Recognition in Complex Scenes

Recognition of Hand Gesture Image Using Deep Convolutional Neural Network

An Improved Gesture Segmentation Method for Gesture Recognition Based on CNN and YCbCr

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Gesture Feature Extraction and Recognition Based on Image Processing

Multimode Gesture Recognition Algorithm Based on Convolutional Long Short-Term Memory Network

Convolutional neural network with spatial pyramid pooling for hand gesture recognition

Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method

A Comprehensive Evaluation of Moving Static Gesture Recognition with Convolutional Networks

A novel hand gesture detection and recognition system based on ensemble-based convolutional neural network

Hand Gesture Recognition with Skin Detection and Deep Learning Method

Gesture recognition based on deep deformable 3D convolutional neural networks

Doppler-Radar Based Hand Gesture Recognition System Using Convolutional Neural Networks

Short-Term Temporal Convolutional Networks for Dynamic Hand Gesture Recognition

Hand Gesture Recognition in Complex Background Based on Convolutional Pose Machine and Fuzzy Gaussian Mixture Models

Hand Calculator System using Convolutional Neural Networks

A Hybrid CNN-LSTM Network for Hand Gesture Recognition with Surface EMG Signals

Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Recurrent Neural Network

Innovative healthcare solutions: robust hand gesture recognition of daily life routines using 1D CNN

An Efficient Human Computer Interaction through Hand Gesture Using Deep Convolutional Neural Network