Action and Gait Recognition from Recovered 3-D Human Joints

Junxia Gu,Xiaoqing Ding,Shengjin Wang,Youshou Wu

DOI: https://doi.org/10.1109/tsmcb.2010.2043526

2010-01-01

IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics)

Abstract:A common viewpoint-free framework that fuses pose recovery and classification for action and gait recognition is presented in this paper. First, a markerless pose recovery method is adopted to automatically capture the 3-D human joint and pose parameter sequences from volume data. Second, multiple configuration features (combination of joints) and movement features (position, orientation, and height of the body) are extracted from the recovered 3-D human joint and pose parameter sequences. A hidden Markov model (HMM) and an exemplar-based HMM are then used to model the movement features and configuration features, respectively. Finally, actions are classified by a hierarchical classifier that fuses the movement features and the configuration features, and persons are recognized from their gait sequences with the configuration features. The effectiveness of the proposed approach is demonstrated with experiments on the Institut National de Recherche en Informatique et Automatique Xmas Motion Acquisition Sequences data set.