Abstract:Hand gesture recognition has attracted more interest in computer vision and image processing recently. Recent works for hand gesture recognition confronted 2 major problems. The former one is how to detect and extract the hand region from color-confusing background objects. The latter one is the expensive computational cost by considering the kinematic hand model with up to 27 degrees of freedom.This paper proposes a stable and real-time static hand gesture recognition system. Our contributions are listed as follows. First, to deal with color-confusing background objects, we take the RGB-D (RGB-Depth) information into account, where foreground and background objects can be segmented well. Additionally, a coarse-to-fine model is proposed, which utilizes the skin color and helps us extract the hand region robustly and accurately. Second, considering the principal direction of hand region is random, we introduce the principal component analysis (PCA) algorithm to estimate and then compensate the direction. Finally, to avoid the expensive computational cost of traditional optimization, we design a fingertip filter and detect extended fingers via calculating their distances to palm center and curvature easily. Then the number of extended fingers will be reported, which corresponds to the recognition result.Experiments have verified the stability and high-speed of our algorithm. On the data set captured by the depth camera, our algorithm recognizes the 6 pre-defined static hand gestures robustly with average accuracy about 98.0%. Furthermore, the average computational time for each image (with the resolution 640x480) is 37ms, which can be extended to many real-time applications.

Hand Image Segmentation Using Color and RCE Neural Network.

Multi-objects Real Time Recognition Based on Color Information

Application of Color Recognition Method Based on Neural Network in RoboCup Environment

Improved RCE neural network and its application in human-robot interaction based on hand gesture recognition

Hand Segmentation and Fingertip Tracking from Depth Camera Images Using Deep Convolutional Neural Network and Multi-task SegNet

Adaptive Threshold Gesture Segmentation Algorithm Based on Skin Color

Real-Time Hand Gesture Recognition Using RGB-D Sensor

Point Cloud Hand–Object Segmentation Using Multimodal Imaging with Thermal and Color Data for Safe Robotic Object Handover

Research on Hand Detection in Complex Scenes Based on RGB-D Sensor

Hand Segmentation for Hand-based Biometrics in Complex Environments

Gesture Feature Extraction and Recognition Based on Image Processing

Hand Gesture Recognition with Skin Detection and Deep Learning Method

Image segmentation with color and texture using RBFNN minimizing the L-GEM

Integrating Color and Depth Cues for Static Hand Gesture Recognition.

Multi-color Space Learning for Image Segmentation Based on a Support Vector Machine

Human segmentation of infrared image for mobile robot search

An Improved Gesture Segmentation Method for Gesture Recognition Based on CNN and YCbCr

Deep Attention Network for Joint Hand Gesture Localization and Recognition Using Static RGB-D Images.

Stable And Real-Time Hand Gesture Recognition Based On Rgb-D Data

Hand Function Rehabilitation Training Robot Based on Ycbcr and CNN

Visual Hand Gesture Recognition With Convolution Neural Network