Human Interaction Recognition Based on Transformation of Spatial Semantics

Biao Jin,Wenlong Hu,Hongqi Wang
DOI: https://doi.org/10.1109/lsp.2012.2183364
2012-01-01
IEEE Signal Processing Letters
Abstract:This letter proposes a novel approach for automated recognition of human-human interactions. First, the motion directions are obtained and the spatial relationships between persons (topological and directional relations) are modeled based on the tracking results. Then, we propose a method to extract the spatial semantics between persons, including front, back, face to face, back to back, and left or right. Finally, we adopt context-free grammar (CFG) to recognize the interactions, and thereinto the production rules are established based on the transformation of spatial semantics. Extensive experiments validate the effectiveness of the proposed approach.
What problem does this paper attempt to address?