Abstract:Hand gesture recognition has attracted more interest in computer vision and image processing recently. Recent works for hand gesture recognition confronted 2 major problems. The former one is how to detect and extract the hand region from color-confusing background objects. The latter one is the expensive computational cost by considering the kinematic hand model with up to 27 degrees of freedom.This paper proposes a stable and real-time static hand gesture recognition system. Our contributions are listed as follows. First, to deal with color-confusing background objects, we take the RGB-D (RGB-Depth) information into account, where foreground and background objects can be segmented well. Additionally, a coarse-to-fine model is proposed, which utilizes the skin color and helps us extract the hand region robustly and accurately. Second, considering the principal direction of hand region is random, we introduce the principal component analysis (PCA) algorithm to estimate and then compensate the direction. Finally, to avoid the expensive computational cost of traditional optimization, we design a fingertip filter and detect extended fingers via calculating their distances to palm center and curvature easily. Then the number of extended fingers will be reported, which corresponds to the recognition result.Experiments have verified the stability and high-speed of our algorithm. On the data set captured by the depth camera, our algorithm recognizes the 6 pre-defined static hand gestures robustly with average accuracy about 98.0%. Furthermore, the average computational time for each image (with the resolution 640x480) is 37ms, which can be extended to many real-time applications.

An Integrative Framework of Human Hand Gesture Segmentation for Human–Robot Interaction

Real-Time Hand Gesture Recognition Using RGB-D Sensor

A Framework Of Real Time Hand Gesture Vision Based Human-Computer Interaction

Real-time dynamic gesture recognition system based on depth perception for robot navigation

Hand gesture segmentation, recognition and application

Efficient Hand Gesture Recognition for Human-Robot Interaction

Research on Hand Detection in Complex Scenes Based on RGB-D Sensor

Real-time Fingertip Tracking and Gesture Recognition Using RGB-D Camera

A Deep Learning Framework for Recognizing both Static and Dynamic Gestures

Improved RCE neural network and its application in human-robot interaction based on hand gesture recognition

Stable And Real-Time Hand Gesture Recognition Based On Rgb-D Data

HRC of intelligent assembly system based on multimodal gesture control

Gesture Based Human-Robot Interaction Using a Frame Based Software Platform

A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors

Interaction-Free Hand Segmentation Using Kinect Camera

Dynamic Hand Gesture Recognition Based on 3D Hand Pose Estimation for Human-Robot Interaction

Real-Time and Continuous Hand Gesture Spotting: an Approach Based on Artificial Neural Networks

Human-robot Interaction Method Combining Human Pose Estimation and Motion Intention Recognition

A Vision-Based Gesture Recognition System For Human-Robot Interaction

A Robust Method of Detecting Hand Gestures Using Depth Sensors

Research on the Hand Gesture Recognition Based on Deep Learning