Human Action Recognition with Graph-Based Multiple-Instance Learning

yang yi,maoqing lin
DOI: https://doi.org/10.1016/j.patcog.2015.11.022
IF: 8
2016-01-01
Pattern Recognition
Abstract:A new approach to human action recognition from realistic videos is presented in this paper. First, an affine motion model is utilized to compensate background motion for the purpose of extracting dense foreground trajectories. Then, a trajectory spectral embedding is introduced to split up foreground action into multiple spatio-temporal action parts for constructing a mid-level representation. To deal with over-segmentation, a novel density discontinuity detector is proposed for the sake of generating semantically salient action parts. Finally, to handle the ambiguity in the training set, action classification is formulated within the multiple-instance learning framework, which a spatio-temporal graph model is incorporated into. Extensive experiments show that the proposed approach achieves competitive results to state of the art on UCF Sports, Kisses/Slaps, YouTube, and Hollywood datasets. A motion compensation approach based on affine model is introduced.A density discontinuity detector is proposed to deal with over-segmentation.The bag of histograms is presented to develop the bag of features.A graph-based multiple-instance learning method is proposed to handle ambiguity.
What problem does this paper attempt to address?