Abstract:With an increasing number of people on the planet today, innovative human-computer interaction technologies and approaches may be employed to assist individuals in leading more fulfilling lives. Gesture-based technology has the potential to improve the safety and well-being of impaired people, as well as the general population. Recognizing gestures from video streams is a difficult problem because of the large degree of variation in the characteristics of each motion across individuals. In this article, we propose applying deep learning methods to recognize automated hand gestures using RGB and depth data. To train neural networks to detect hand gestures, any of these forms of data may be utilized. Gesture-based interfaces are more natural, intuitive, and straightforward. Earlier study attempted to characterize hand motions in a number of contexts. Our technique is evaluated using a vision-based gesture recognition system. In our suggested technique, image collection starts with RGB video and depth information captured with the Kinect sensor and is followed by tracking the hand using a single shot detector Convolutional Neural Network (SSD-CNN). When the kernel is applied, it creates an output value at each of the m n locations. Using a collection of convolutional filters, each new feature layer generates a defined set of gesture detection predictions. After that, we perform deep dilation to make the gesture in the image masks more visible. Finally, hand gestures have been detected using the well-known classification technique SVM. Using deep learning we recognize hand gestures with higher accuracy of 93.68% in RGB passage, 83.45% in the depth passage, and 90.61% in RGB-D conjunction on the SKIG dataset compared to the state-of-the-art. In the context of our own created Different Camera Orientation Gesture (DCOG) dataset we got higher accuracy of 92.78% in RGB passage, 79.55% in the depth passage, and 88.56% in RGB-D conjunction for the gestures collected in 0-degree angle. Moreover, the framework intends to use unique methodologies to construct a superior vision-based hand gesture recognition system.

An Integrative Approach to Robust Hand Detection Using CPM-YOLOv3 and RGBD Camera in Real Time.

YOLO Series for Human Hand Action Detection and Classification from Egocentric Videos

Gesture Detection and Recognition Based on Object Detection in Complex Background

Real-Time Hand Gesture Recognition Using RGB-D Sensor

A Robust Context Attention Network for Human Hand Detection

Robust 3D Hand Detection from a Single RGB-D Image in Unconstrained Environments

Single Shot Detector CNN and Deep Dilated Masks for Vision-Based Hand Gesture Recognition From Video Sequences

An Efficient Human Computer Interaction through Hand Gesture Using Deep Convolutional Neural Network

Robust Hand Detection and Tracking Based on Monocular Vision

Robust Real-Time Human Perception with Depth Camera.

HGR-FYOLO: a robust hand gesture recognition system for the normal and physically impaired person using frozen YOLOv5

Point Cloud Hand–Object Segmentation Using Multimodal Imaging with Thermal and Color Data for Safe Robotic Object Handover

Reliably Detecting Humans in Crowded and Dynamic Environments Using RGB-D Camera

A Deep Learning-Based End-to-End Composite System for Hand Detection and Gesture Recognition

Novel Human Machine Interface via Robust Hand Gesture Recognition System using Channel Pruned YOLOv5s Model

Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images

HandyNet: A One-stop Solution to Detect, Segment, Localize & Analyze Driver Hands

Joint Hand Detection and Rotation Estimation by Using CNN

Development and Validation of an Artificial Neural Network for the Recognition of Custom Dataset with YOLOv4

Stable And Real-Time Hand Gesture Recognition Based On Rgb-D Data