Abstract:The performance of action recognition in video sequences depends significantly on the representation of actions and the similarity measurement between the representations. In this paper, we combine two kinds of features extracted from the spatio-temporal interest points with context-aware kernels for action recognition. For the action representation, local cuboid features extracted around interest points are very popular using a Bag of Visual Words (BOVW) model. Such representations, however, ignore potentially valuable information about the global spatio-temporal distribution of interest points. We propose a new global feature to capture the detailed geometrical distribution of interest points. It is calculated by using the 3D ℛ transform which is defined as an extended 3D discrete Radon transform, followed by the application of a two-directional two-dimensional principal component analysis. For the similarity measurement, we model a video set as an optimized probabilistic hypergraph and propose a context-aware kernel to measure high order relationships among videos. The context-aware kernel is more robust to the noise and outliers in the data than the traditional context-free kernel which just considers the pairwise relationships between videos. The hyperedges of the hypergraph are constructed based on a learnt Mahalanobis distance metric. Any disturbing information from other classes is excluded from each hyperedge. Finally, a multiple kernel learning algorithm is designed by integrating the l_2 norm regularization into a linear SVM classifier to fuse the ℛ feature and the BOVW representation for action recognition. Experimental results on several datasets demonstrate the effectiveness of the proposed approach for action recognition.

Entropy-based action features selection using histogram intersection kernel

An Empirical Study for Human Behavior Analysis

Human Action Recognition Using Multi-Velocity STIPs and Motion Energy Orientation Histogram.

Spatio-Temporal Proximity Distribution Kernels for Action Recognition

Action Recognition Using Discriminative Spatio-Temporal Neighborhood Features

Human Action Recognition by Using Polyhedron Model-Based Spatio-Temporal Gradient Descriptor

Human Activity Recognition Based on Pose Points Selection

Action Recognition Via Cumulative Histogram of Multiple Features

Human Action Recognition under Log-Euclidean Riemannian Metric.

Local feature extraction using time domain information for human action recognition

Hmnan Action Recognition in Complex Scenes Based on Fuzzy Integral Fusion

Fusing $${\mathcal {R}}$$R Features and Local Features with Context-Aware Kernels for Action Recognition

Human action classification using histogram-based discriminative embedding

A Spatial-Temporal Constraint-Based Action Recognition Method

Robust Human Action Recognition Based on Spatio-Temporal Descriptors and Motion Temporal Templates

Human action recognition in videos using hybrid motion features

Human Action Detection Via Boosted Local Motion Histograms

Spatio-temporal Semantic Features for Human Action Recognition.

Time-ordered Spatial-Temporal Interest Points for Human Action Classification.

Action Detection by Fusing Hierarchically Filtered Motion with Spatiotemporal Interest Point Features

Human Action Recognition By Som Considering The Probability Of Spatio-Temporal Features