Abstract:Gesture recognition, as one of the most promising human-robot interaction approaches, has attracted research interests for a long time. Though many feasible methods have been proposed in this field, the current gesture modeling and recognition methods are deficient in expressiveness, naturalness, and efficiency. In this paper, we present a novel method of modeling and recognizing natural gestures in 3-D space. Inspired by the joint space modeling, which is frequently used in robotics, we decompose the gestures into information of joint movements, joint angles, and arm orientations. We calculate joint angles and detect joint movements with the orientation data measured by inertial measurement units. Numbers of gestures can be modeled by combining three types of criteria, namely, joint angle criteria, arm orientation criteria, and joint movement criteria. Our system can cope with the repetitive movements, which are common in gestures while rarely considered before. Different from the previous statistical learning or template matching approaches, our approach does not need training. User can add new gesture to the gesture set or edit existing gesture definitions conveniently. To evaluate our system, we conducted real-time gesture recognition experiments with ten subjects. Twelve gestures, including three static gestures and nine dynamic gestures, were modeled for the experiments. The average recognition accuracy of totaling 1560 gesture samples was 91.86%.

Online Gesture-Based Interaction with Visual Oriental Characters Based on Manifold Learning.

Dynamic hand gesture recognition using hidden Markov models

An online sketching and gesture editing system for conceptual design

Exploitation of Multiplayer Interaction and Development of Virtual Puppetry Storytelling Using Gesture Control and Stereoscopic Devices.

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

An interaction system using mixed hand gestures.

3D Intuitive Gesture Interaction via Motion Sensing

Interaction and control with the auxiliary of hand gesture

Gesture Recognition with a 3-D Accelerometer

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

On-Line Sketch Recognition Using Direction Feature

Online human gesture recognition from motion data streams.

Semg-Based Gesture Recognition with Embedded Virtual Hand Poses and Adversarial Learning.

Exploiting Serialized Fine-Grained Action Recognition Using WiFi Sensing

Vision-based Interpretation of Hand Gestures by Modeling Appearance Changes in Image Sequences.

Motion-Based Segmentation Scheme to Feature Extraction of Hand Gestures

Separating and Recognizing Gestural Strokes for Sketch-Based Interfaces

Large Scale Entertainment System based on Gesture Recognition for Learning Chinese Character Contents

A Vision-Based Gesture Recognition System For Human-Robot Interaction

Natural Gesture Modeling and Recognition Approach Based on Joint Movements and Arm Orientations

A Real Time Vision-Based Hand Gestures Recognition System