Abstract:3D skeletal data has recently attracted wide attention in human behavior analysis for its robustness to variant scenes, while accurate gesture recognition is still challenging. The main reason lies in the high intra-class variance caused by temporal dynamics. A solution is resorting to the generative models, such as the hidden Markov model (HMM). However, existing methods commonly assume fixed anchors for each hidden state, which is hard to depict the explicit temporal structure of gestures. Based on the observation that a gesture is a time series with distinctly defined phases, we propose a new formulation to build temporal compositions of gestures by the low-rank matrix decomposition. The only assumption is that the gesture's "hold" phases with static poses are linearly correlated among each other. As such, a gesture sequence could be segmented into temporal states with semantically meaningful and discriminative concepts. Furthermore, different to traditional HMMs which tend to use specific distance metric for clustering and ignore the temporal contextual information when estimating the emission probability, the Long Short-Term Memory (LSTM) is utilized to learn probability distributions over states of HMM. The proposed method is validated on two challenging datasets. Experiments demonstrate that our approach can effectively work on a wide range of gestures and actions, and achieve state-of-the-art performance.

Dynamic hand gesture recognition using hidden Markov models

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

An interaction system using mixed hand gestures.

A real-time hand gesture recognition method

Dynamic hand gesture early recognition based on Hidden Semi-Markov Models

Mixed Hand Gesture Recognition System And Its Application

A Real Time Vision-Based Hand Gestures Recognition System

Non-intrusive gesture recognition system combining with face detection based on Hidden Markov Model

Hand Gesture Recognition in Complex Background Based on Convolutional Pose Machine and Fuzzy Gaussian Mixture Models

Hidden States Exploration for 3D Skeleton-Based Gesture Recognition.

Hidden Markov models based dynamic hand gesture recognition with incremental learning method

Gesture recognition based on HMM-FNN model using a Kinect

Gesture Recognition with a 3-D Accelerometer

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

A Computer Vision-Based Gesture Recognition Using Hidden Markov Model

Interaction and control with the auxiliary of hand gesture

HMM-based operational gesture recognition method

Online human gesture recognition from motion data streams.

Visual gesture recognition for human robot interaction using dynamic movement primitives

A Real-Time Approach to the Spotting, Representation, and Recognition of Hand Gestures for Human–Computer Interaction

3D Skeletal Gesture Recognition Via Hidden States Exploration