Abstract:The key problems of dynamic hand gesture recognition are large intra-class (gesture types, without considering hand configuration) spatial-temporal variability and similar inter-class (gesture types, only considering hand configuration) motion pattern. Firstly, for intra-class spatial-temporal variability, the key is to reduce the spatial-temporal variability. Due to the average operation can improve the robustness very well, we propose a motion pattern descriptor, Time-Wise Histograms of Oriented Gradients (TWHOG), which extracts the average spatial-temporal information in the space-time domain from three orthogonal projection views (XY, YT, XT). Secondly, for similar inter-class motion pattern, accurate representation of hand configuration is especially important. Therefore, the difference in detail needs to be fully captured, and the shape descriptor can amplify subtle differences. Specifically, we introduce Depth Motion Maps-based Histograms of Oriented Gradients (DMM-HOG) to capture subtle differences in hand configurations between different types of gestures with similar motion patterns. Finally, we concatenate TWHOG and DMM-HOG to form the final feature vector Time-Shape Histograms of Oriented Gradients (TSHOG) and verify the effectiveness of the connection from quantitative and qualitative perspective. Comparison study with the state-of-the-art approaches are conducted on two challenge depth gesture datasets (MSRGesture3D, SKIG). The experiment result shows that TSHOG can achieve satisfactory performance while keeping a relative simple model with lower complexity as well as higher generality.

A Windowed Dynamic Time Warping Approach for 3D Continuous Hand Gesture Recognition

Dynamic hand gesture recognition using hidden Markov models

Structured Dynamic Time Warping for Continuous Hand Trajectory Gesture Recognition

An Image-to-class Dynamic Time Warping Approach for Both 3D Static and Trajectory Hand Gesture Recognition

A Dynamic Hand Gesture Recognition Model Based on the Improved Dynamic Time Warping Algorithm.

Recognizing 3D Continuous Letter Trajectory Gesture Using Dynamic Time Warping.

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

Combining Point Context and Dynamic Time Warping for Online Gesture Recognition

Image-to-Class Dynamic Time Warping for 3D hand gesture recognition

Novel Algorithm for Hand Gesture Recognition Utilizing a Wrist-Worn Inertial Sensor

Multi-modal Gesture Recognition with Voting-Based Dynamic Time Warping

Dynamic Hand Gesture Recognition Using Motion Trajectories and Key Frames

Dynamic Gesture Recognition Based On Improved Dtw Algorithm

Dynamic Hand Gesture Recognition Using Motion Pattern and Shape Descriptors

Accelerometer-based Gesture Recognition Using Dynamic Time Warping and Sparse Representation

Non-contact Gesture Recognition Method Based on the Information of the Human Arm Joint

Continuous Motion Classification and Segmentation Based on Improved Dynamic Time Warping Algorithm.

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

Continuous Gesture Segmentation and Recognition Using 3DCNN and Convolutional LSTM

A two-handed gesture recognition technique on mobile devices based on improved DTW algorithm