Motion-Based Segmentation Scheme to Feature Extraction of Hand Gestures

YX Zhu,Y Huang,GY Xu,CH Yu

DOI: https://doi.org/10.1117/12.323643

1998-01-01

Abstract:The key: motivation for visual interpretation of hand gestures is to introduce this natural and intuitive communication mode to human computer interaction (HCI). Visual interpretation of hand gesture had typically made use of high-level parametric models representing the body parts such as arms, figures, palms etc, and their connections to each other. Such 3-D model-based interpretation has been successful in some case; however, heavy computation makes this approach a very difficult task By use of variable-order parameterized models of image motion and robust dominant motion regression, in this paper, we propose a motion-based segmentation scheme to feature extraction of hand gestures. The proposed scheme can directly estimate image motion of an object in two unsegmented images and obtain fine segmentation of that object from background at the same time. Based on inter-frame image motion parameters and the fine segmentation, we can construct various motion features, shape features, or their combinations for the purpose of hand gesture: interpretation. With these features 12 kind of hand gestures used in our experiment can be reliably interpreted.