Abstract:Automatic human action recognition is a core functionality of systems for video surveillance and human object interaction. In the whole recognition system, feature description and encoding represent two crucial key steps. In order to construct a powerful action recognition framework it is important that the two steps must provide reliable performance. In this paper, we proposed a new human action feature descriptor which is called spatial-temporal histograms of gradients (SPHOG). SPHOG is based on the spatial and temporal derivation signal, which extracts the gradient changes between consecutive frames. Compare to the traditional descriptors histograms of optical flow, our proposed SPHOG costs less computation resource. Vector of Locally Aggregated Descriptors (VLAD), which is a popular encoding approach for Bag-of-Feature representation. There is a main drawback of VLAD that it only considers the difference between local descriptor and their centroids. In order to resolve the weakness, we proposed a improved VLAD method called HOD-VLAD, which complementary the distribution information of local descriptors by computing a weight histograms of distance. We validated our proposed algorithm for human action recognition on three public available datasets KTH, UCF Sports and HMDB51. The evaluation experiment results indicate that the proposed descriptor and encoding method can improve the efficiency of human action recognition and the recognition accuracy.

Human action categories using motion descriptors

Human action recognition in videos using hybrid motion features

Human action classification based on sequential bag-of-words model

An Improved Interest Point Detector for Human Action Recognition

Robust Human Action Recognition Based on Spatio-Temporal Descriptors and Motion Temporal Templates

Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling

Human Action Recognition Based on HOIRM Feature Fusion and AP Clustering BOW.

Human Action Detection Via Boosted Local Motion Histograms

Sequential Bag-of-Words Model for Human Action Classification.

Action Recognition by Joint Spatial-Temporal Motion Feature

Human action recognition using late fusion and dimensionality reduction

Assigning PLS Based Descriptors by SVM in Action Recognition

Spatio-temporal Semantic Features for Human Action Recognition.

Spatio-temporal Co-Occurrence Characterizations for Human Action Classification

Action recognition using hybrid spatio-temporal bag-of-features

Spatial-temporal Histograms of Gradients and HOD-VLAD Encoding for Human Action Recognition

Action recognition via restricted dense trajectories and spatio-temporal co-occurrence feature

Learning Discriminative Visual Codebook For Human Action Recognition

Human Action Recognition Using Multi-Velocity STIPs and Motion Energy Orientation Histogram.

Hybrid Generative-Discriminative Human Action Recognition by Combining Spatiotemporal Words with Supervised Topic Models

Sparse Coding on Local Spatial-Temporal Volumes for Human Action Recognition