Abstract:With an increasing number of people on the planet today, innovative human-computer interaction technologies and approaches may be employed to assist individuals in leading more fulfilling lives. Gesture-based technology has the potential to improve the safety and well-being of impaired people, as well as the general population. Recognizing gestures from video streams is a difficult problem because of the large degree of variation in the characteristics of each motion across individuals. In this article, we propose applying deep learning methods to recognize automated hand gestures using RGB and depth data. To train neural networks to detect hand gestures, any of these forms of data may be utilized. Gesture-based interfaces are more natural, intuitive, and straightforward. Earlier study attempted to characterize hand motions in a number of contexts. Our technique is evaluated using a vision-based gesture recognition system. In our suggested technique, image collection starts with RGB video and depth information captured with the Kinect sensor and is followed by tracking the hand using a single shot detector Convolutional Neural Network (SSD-CNN). When the kernel is applied, it creates an output value at each of the m n locations. Using a collection of convolutional filters, each new feature layer generates a defined set of gesture detection predictions. After that, we perform deep dilation to make the gesture in the image masks more visible. Finally, hand gestures have been detected using the well-known classification technique SVM. Using deep learning we recognize hand gestures with higher accuracy of 93.68% in RGB passage, 83.45% in the depth passage, and 90.61% in RGB-D conjunction on the SKIG dataset compared to the state-of-the-art. In the context of our own created Different Camera Orientation Gesture (DCOG) dataset we got higher accuracy of 92.78% in RGB passage, 79.55% in the depth passage, and 88.56% in RGB-D conjunction for the gestures collected in 0-degree angle. Moreover, the framework intends to use unique methodologies to construct a superior vision-based hand gesture recognition system.

Spatiotemporal features representation with dynamic mode decomposition for hand gesture recognition using deep neural networks

Dynamic hand gesture recognition using hidden Markov models

Attention-based hand semantic segmentation and gesture recognition using deep networks

Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition

Dynamic gesture recognition using hand pose-based neural networks for sign language interpretation

Gesture recognition based on deep deformable 3D convolutional neural networks

Hand gesture recognition via deep data optimization and 3D reconstruction

An Advanced Deep Learning Based Three-Stream Hybrid Model for Dynamic Hand Gesture Recognition

A Novel Hybrid Deep Learning Architecture for Dynamic Hand Gesture Recognition

Multimodal Spatiotemporal Feature Map for Dynamic Gesture Recognition

Recognition of Hand Gesture Image Using Deep Convolutional Neural Network

Single Shot Detector CNN and Deep Dilated Masks for Vision-Based Hand Gesture Recognition From Video Sequences

Dynamic Hand Gesture Recognition Using Multi-Branch Attention Based Graph and General Deep Learning Model

A novel static and dynamic hand gesture recognition using self organizing map with deep convolutional neural network

Real-time hand gesture recognition using multiple deep learning architectures

Dyhand: dynamic hand gesture recognition using BiLSTM and soft attention methods

Multistage Spatial Attention-Based Neural Network for Hand Gesture Recognition

Hand Segmentation With Dense Dilated U-Net and Structurally Incoherent Nonnegative Matrix Factorization-Based Gesture Recognition

Hand Gesture Recognition using Image Processing and Feature Extraction Techniques

Short-Term Temporal Convolutional Networks for Dynamic Hand Gesture Recognition

CNN+RNN Depth and Skeleton based Dynamic Hand Gesture Recognition