Abstract:Human action recognition remains challenging in realistic videos, where scale and viewpoint changes make the problem complicated. Many complex models have been developed to overcome these difficulties, while we explore using low-level features and typical classifiers to achieve the state-of-the-art performance. The baseline model of feature encoding for action recognition is bag-of-words model, which has shown high efficiency but ignores the arrangement of local features. Refined methods compensate for this problem by using a large number of co-occurrence descriptors or a concatenation of the local distributions in designed segments. In contrast, this article proposes to encode the relative position of visual words using a simple but very compact method called sliding coordinates coding (SCC). The SCC vector of each kind of word is only an eight-dimensional vector which is more compact than many of the spatial or spatial–temporal pooling methods in the literature. Our key observation is that the relative position is robust to the variations of video scale and view angle. Additionally, we design a temporal cutting scheme to define the margin of coding within video clips, since visual words far away from each other have little relationship. In experiments, four action data sets, including KTH, Rochester Activities, IXMAS, and UCF YouTube, are used for performance evaluation. Results show that our method achieves comparable or better performance than the state of the art, while using more compact and less complex models.

Context and Locality Constrained Linear Coding for Human Action Recognition.

Action Recognition Using Context-Constrained Linear Coding.

Learning Visual Context for Group Activity Recognition.

Local Non-Negative Component Representation for Human Action Recognition

Spatially Regularized and Locality-Constrained Linear Coding for Human Action Recognition

Position and Locality Constrained Soft Coding for Human Action Recognition

Sparse Coding on Local Spatial-Temporal Volumes for Human Action Recognition

Local Spatiotemporal Coding and Sparse Representation Based Human Action Recognition

Multiscale Spatial Position Coding under Locality Constraint for Action Recognition

Learning Discriminative Visual Codebook For Human Action Recognition

Multi-Scale Locality-Constrained Spatiotemporal Coding for Local Feature Based Human Action Recognition

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Action Recognition Using Local Consistent Group Sparse Coding with Spatio-Temporal Structure.

Action Recognition Using Feature Position Constrained Linear Coding

Human action categories using motion descriptors

Recognizing Human Actions Based On Sparse Coding With Non-Negative And Locality Constraints

A Compact Representation of Human Actions by Sliding Coordinate Coding

Exploring Probabilistic Localized Video Representation for Human Action Recognition

Action Recognition and Localization with Spatial and Temporal Contexts

Contextual Fisher Kernels for Human Action Recognition

Local random sparse coding for human action recognition in wireless sensor networks