Abstract:Hand gesture recognition has attracted more interest in computer vision and image processing recently. Recent works for hand gesture recognition confronted 2 major problems. The former one is how to detect and extract the hand region from color-confusing background objects. The latter one is the expensive computational cost by considering the kinematic hand model with up to 27 degrees of freedom.This paper proposes a stable and real-time static hand gesture recognition system. Our contributions are listed as follows. First, to deal with color-confusing background objects, we take the RGB-D (RGB-Depth) information into account, where foreground and background objects can be segmented well. Additionally, a coarse-to-fine model is proposed, which utilizes the skin color and helps us extract the hand region robustly and accurately. Second, considering the principal direction of hand region is random, we introduce the principal component analysis (PCA) algorithm to estimate and then compensate the direction. Finally, to avoid the expensive computational cost of traditional optimization, we design a fingertip filter and detect extended fingers via calculating their distances to palm center and curvature easily. Then the number of extended fingers will be reported, which corresponds to the recognition result.Experiments have verified the stability and high-speed of our algorithm. On the data set captured by the depth camera, our algorithm recognizes the 6 pre-defined static hand gestures robustly with average accuracy about 98.0%. Furthermore, the average computational time for each image (with the resolution 640x480) is 37ms, which can be extended to many real-time applications.

Human-computer interaction system for hand recognition based on depth information from Kinect sensor

Dynamic hand gesture recognition using hidden Markov models

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

Human-Computer Interaction Using Fingertip Based on Kinect

Real-Time Hand Gesture Recognition Using RGB-D Sensor

Design of hand gesture recognition system for human-computer interaction

Contact-free and Pose-Invariant Hand-Biometric-based Personal Identification System Using RGB and Depth Data

An interaction system using mixed hand gestures.

Depth camera based hand gesture recognition and its applications in Human-Computer-Interaction

Kinect Sensor-Based Long-Distance Hand Gesture Recognition and Fingertip Detection with Depth Information

Mixed Hand Gesture Recognition System And Its Application

Hand recognition method based on color and depth information from first-person view

A touchable virtual screen interaction system with handheld Kinect camera

Stable And Real-Time Hand Gesture Recognition Based On Rgb-D Data

Perceiving Motion Cues Inspired by Microsoft Kinect Sensor on Game Experiencing

A Framework Of Real Time Hand Gesture Vision Based Human-Computer Interaction

Dynamic human object recognition by combining color and depth information with a clothing image histogram

Real-time Fingertip Tracking and Gesture Recognition Using RGB-D Camera

Real-time Hand Gesture Recognition with Kinect for Playing Racing Video Games

A Real-Time Approach to the Spotting, Representation, and Recognition of Hand Gestures for Human–Computer Interaction