Abstract:Real-time Human action classification in complex scenes has applications in various domains such as visual surveillance, video retrieval and human robot interaction. While, the task is challenging due to computation efficiency, cluttered backgrounds and intro-variability among same type of actions. Spatio-temporal interest point (STIP) based methods have shown promising results to tackle human action classification in complex scenes efficiently. However, the state-of-the-art works typically utilize bag-of-visual words (BoVW) model which only focuses on the word distribution of STIPs and ignore the distinctive character of word structure. In this paper, the distribution of STIPs is organized into a salient directed graph, which reflects salient motions and can be divided into a time salient directed graph and a space salient directed graph, aiming at adding spatio-temporal discriminant to BoVW. Generally speaking, both salient directed graphs are constructed by labeled STIPs in pairs. In detail, the "directional co-occurrence" property of different labeled pairwise STIPs in same frame is utilized to represent the time saliency, and the space saliency is reflected by the "geometric relationships" between same labeled pairwise STIPs across different frames. Then, new statistical features namely the Time Salient Pairwise feature (TSP) and the Space Salient Pairwise feature (SSP) are designed to describe two salient directed graphs, respectively. Experiments are carried out with a homogeneous kernel SVM classifier, on four challenging datasets KTH, ADL and UT-Interaction. Final results confirm the complementary of TSP and SSP, and our multi-cue representation TSP + SSP + BoVW can properly describe human actions with large intro-variability in real-time. Copyright (C) 2016, Chongqing University of Technology. Production and hosting by Elsevier B.V.

A Novel 3D Gradient LBP Descriptor for Action Recognition

Robust 3D Action Recognition Through Sampling Local Appearances and Global Distributions.

3D R Transform on Spatio-temporal Interest Points for Action Recognition

Recognizing human actions using a new descriptor based on spatial-temporal interest points and weighted-output classifier.

Deep spatiotemporal LSTM network with temporal pattern feature for 3D human action recognition

Spatiotemporal Interaction Residual Networks with Pseudo3D for Video Action Recognition.

3D Action Recognition Using Multi-Temporal Depth Motion Maps and Fisher Vector

Spatio-temporal Laplacian Pyramid Coding for Action Recognition.

Multi-Temporal Depth Motion Maps-Based Local Binary Patterns for 3-D Human Action Recognition

Exploring 3d Human Action Recognition: From Offline To Online

Salient Pairwise Spatio-Temporal Interest Points for Real-Time Activity Recognition.

Spatio-Temporal Proximity Distribution Kernels for Action Recognition

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Machine Vision-Based Human Action Recognition Using Spatio-Temporal Motion Features (STMF) with Difference Intensity Distance Group Pattern (DIDGP)

Action Recognition Via Cumulative Histogram of Multiple Features

A Novel 3D Human Action Recognition Framework for Video Content Analysis.

Human Action Recognition Using Multi-Velocity STIPs and Motion Energy Orientation Histogram.

Empowering Efficient Spatio-Temporal Learning with a 3D CNN for Pose-Based Action Recognition

HOPC: Histogram of Oriented Principal Components of 3D Pointclouds for Action Recognition

Spatio-Temporal Attention Networks for Action Recognition and Detection

Spatio-Temporal Attention-Based LSTM Networks for 3D Action Recognition and Detection