Abstract:Human action recognition remains challenging in realistic videos, where scale and viewpoint changes make the problem complicated. Many complex models have been developed to overcome these difficulties, while we explore using low-level features and typical classifiers to achieve the state-of-the-art performance. The baseline model of feature encoding for action recognition is bag-of-words model, which has shown high efficiency but ignores the arrangement of local features. Refined methods compensate for this problem by using a large number of co-occurrence descriptors or a concatenation of the local distributions in designed segments. In contrast, this article proposes to encode the relative position of visual words using a simple but very compact method called sliding coordinates coding (SCC). The SCC vector of each kind of word is only an eight-dimensional vector which is more compact than many of the spatial or spatial–temporal pooling methods in the literature. Our key observation is that the relative position is robust to the variations of video scale and view angle. Additionally, we design a temporal cutting scheme to define the margin of coding within video clips, since visual words far away from each other have little relationship. In experiments, four action data sets, including KTH, Rochester Activities, IXMAS, and UCF YouTube, are used for performance evaluation. Results show that our method achieves comparable or better performance than the state of the art, while using more compact and less complex models.

Hessian Regularized Sparse Coding for Human Action Recognition.

P-Laplacian Regularized Sparse Coding for Human Activity Recognition

Spatio-temporal Laplacian Pyramid Coding for Action Recognition.

Latent Semantic Learning by Efficient Sparse Coding with Hypergraph Regularization.

Action Recognition Based on Spatio-temporal Log-Euclidean Covariance Matrix

Sparse Coding on Local Spatial-Temporal Volumes for Human Action Recognition

Human Action Recognition Using Sparse Representation

Human Action Recognition Using Deep Learning Methods.

Combining Sparse And Dense Descriptors With Temporal Semantic Structures For Robust Human Action Recognition

Human Action Recognition From Digital Videos Based on Deep Learning.

Hessian Sparse Coding

Sparse Coding-Based Spatiotemporal Saliency for Action Recognition

A Compact Representation of Human Actions by Sliding Coordinate Coding

Action Recognition Using Nonnegative Action Component Representation and Sparse Basis Selection

Action Recognition Using Low-Rank Sparse Representation

Multiscale Spatial Position Coding under Locality Constraint for Action Recognition

Action recognition method based on sparse coding local spatio-temporal descriptors

Multiview Hessian regularized logistic regression for action recognition

A Non-negative Low Rank and Sparse Model for Action Recognition.

3d Gaussian Bin Based Sparse Representation For Action Recognition

Action Recognition Using Context-Constrained Linear Coding.