Abstract:The performance of action recognition in video sequences depends significantly on the representation of actions and the similarity measurement between the representations. In this paper, we combine two kinds of features extracted from the spatio-temporal interest points with context-aware kernels for action recognition. For the action representation, local cuboid features extracted around interest points are very popular using a Bag of Visual Words (BOVW) model. Such representations, however, ignore potentially valuable information about the global spatio-temporal distribution of interest points. We propose a new global feature to capture the detailed geometrical distribution of interest points. It is calculated by using the 3D ℛ transform which is defined as an extended 3D discrete Radon transform, followed by the application of a two-directional two-dimensional principal component analysis. For the similarity measurement, we model a video set as an optimized probabilistic hypergraph and propose a context-aware kernel to measure high order relationships among videos. The context-aware kernel is more robust to the noise and outliers in the data than the traditional context-free kernel which just considers the pairwise relationships between videos. The hyperedges of the hypergraph are constructed based on a learnt Mahalanobis distance metric. Any disturbing information from other classes is excluded from each hyperedge. Finally, a multiple kernel learning algorithm is designed by integrating the l_2 norm regularization into a linear SVM classifier to fuse the ℛ feature and the BOVW representation for action recognition. Experimental results on several datasets demonstrate the effectiveness of the proposed approach for action recognition.

Combining Localized Oriented Rectangles and Motion History Image for Human Action Recognition

Subspace Analysis Methods Plus Motion History Image for Human Action Recognition

Human action recognition in videos using hybrid motion features

Human Action Recognition Using Multi-Velocity STIPs and Motion Energy Orientation Histogram.

Oriented Gradients for Human Action Recognition.

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Human Action Recognition Based on HOIRM Feature Fusion and AP Clustering BOW.

Human action recognition in videos using motion impression image

Reassessing Hierarchical Representation for Action Recognition in Still Images

Human Action Recognition Based on DMMs, HOGs and Contourlet Transform

View-invariant Human Action Recognition Via Robust Locally Adaptive Multi-View Learning

Multimodal human action recognition based on spatio-temporal action representation recognition model

Recognizing actions using depth motion maps-based histograms of oriented gradients

Human action recognition using Adaptive Hierarchical Depth Motion Maps and Gabor filter

Combining Sparse And Dense Descriptors With Temporal Semantic Structures For Robust Human Action Recognition

Human Action Recognition under Log-Euclidean Riemannian Metric.

DMMs-Based Multiple Features Fusion for Human Action Recognition

Fusing $${\mathcal {R}}$$R Features and Local Features with Context-Aware Kernels for Action Recognition

Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling

Multi-Temporal Depth Motion Maps-Based Local Binary Patterns for 3-D Human Action Recognition

Joint Dynamic Pose Image and Space Time Reversal for Human Action Recognition from Videos