Abstract:This paper presents a robust framework of human-computer interaction from the hand gesture vision in the presence of realistic and challenging scenarios. To this end, several novel components are proposed. A hybrid approach is first proposed to automatically infer the beginning position of hand gestures of interest via jointly optimizing the regions given by an offline skin model trained from Gaussian mixture models and a specific hand gesture classifier trained from the Adaboost technique. To consistently track the hand in the context of using kernel based tracking, a semi-supervised feature selection strategy is further presented to choose the feature subspaces which appropriately represent the properties of offline hand skin cues and online foreground-background-classification cues. Taking the histogram of oriented gradients as the descriptor to represent hand gestures, a soft-decision approach is finally proposed for recognizing static hand gestures at the locations where severe ambiguity occurs and hidden Markov model based dynamic gestures are employed for interaction. Experiments on various real video sequences show the superior performance of the proposed components. In addition, the whole framework is applicable to real-time applications on general computing platforms.

A hybrid HMM/particle filter framework for non-rigid hand motion recognition

Joint Bayes Filter: A Hybrid Tracker For Non-Rigid Hand Motion Recognition

Dynamic hand gesture recognition using hidden Markov models

Probabilistic tracking and recognition of nonrigid hand motion

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

A real-time hand gesture recognition method

Effective Inertial Hand Gesture Recognition Using Particle Filtering Based Trajectory Matching

Real-time Hand Tracking Using a Mean Shift Embedded Particle Filter

Real Time Hand Tracking By Combining Particle Filtering And Mean Shift

Robust Visual Tracking Based on Joint Multi-Feature Histogram by Integrating Particle Filter and Mean Shift

3D Hand Motion Tracking Using Improved Hidden Markov Model of Behavior

Robust Head Tracking Based on a Multi-State Particle Filter

A Framework Of Real Time Hand Gesture Vision Based Human-Computer Interaction

A Hybrid Framework for 3-D Human Motion Tracking

Learning-based Tracking of Complex Non-Rigid Motion

Hand Posture Recognition in Video Using Multiple Cues

Tracking Face Poses Toward Meeting Video Analysis

Robust Hand Tracking Based on Online Learning and Multi-Cue Flocks of Features

A Hybrid HMM/DPA Adaptive Gesture Recognition Method

Visual Tracking and Recognition Using Adaptive Probabilistic Appearance Manifold in Particle Filter

Hand Motion Recognition Based on a 3D Fingertip Detection Fusion Method