Abstract:Real-time Human action classification in complex scenes has applications in various domains such as visual surveillance, video retrieval and human robot interaction. While, the task is challenging due to computation efficiency, cluttered backgrounds and intro-variability among same type of actions. Spatio-temporal interest point (STIP) based methods have shown promising results to tackle human action classification in complex scenes efficiently. However, the state-of-the-art works typically utilize bag-of-visual words (BoVW) model which only focuses on the word distribution of STIPs and ignore the distinctive character of word structure. In this paper, the distribution of STIPs is organized into a salient directed graph, which reflects salient motions and can be divided into a time salient directed graph and a space salient directed graph, aiming at adding spatio-temporal discriminant to BoVW. Generally speaking, both salient directed graphs are constructed by labeled STIPs in pairs. In detail, the "directional co-occurrence" property of different labeled pairwise STIPs in same frame is utilized to represent the time saliency, and the space saliency is reflected by the "geometric relationships" between same labeled pairwise STIPs across different frames. Then, new statistical features namely the Time Salient Pairwise feature (TSP) and the Space Salient Pairwise feature (SSP) are designed to describe two salient directed graphs, respectively. Experiments are carried out with a homogeneous kernel SVM classifier, on four challenging datasets KTH, ADL and UT-Interaction. Final results confirm the complementary of TSP and SSP, and our multi-cue representation TSP + SSP + BoVW can properly describe human actions with large intro-variability in real-time. Copyright (C) 2016, Chongqing University of Technology. Production and hosting by Elsevier B.V.

Application-Agnostic Spatio-Temporal Hand Graph Representations for Stable Activity Understanding.

Automatic Interaction and Activity Recognition from Videos of Human Manual Demonstrations with Application to Anomaly Detection

Spatio-Temporal Action Graph Networks

Action Recognition Based on Global Optimal Similarity Measuring

Spatial Temporal Graph Attention Network for Skeleton-Based Action Recognition

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Versatile Graph Neural Networks Toward Intuitive Human Activity Understanding

Salient Pairwise Spatio-Temporal Interest Points for Real-Time Activity Recognition.

Structured Feature-Graph Model for Human Activity Recognition

Enhancing human behavior recognition with spatiotemporal graph convolutional neural networks and skeleton sequences

Hidden States Exploration for 3D Skeleton-Based Gesture Recognition.

A motion-aware and temporal-enhanced Spatial–Temporal Graph Convolutional Network for skeleton-based human action segmentation

Skeleton-Based Action Recognition with Spatial-Structural Graph Convolution

Spatio-Temporal Pyramid Graph Convolutions for Human Action Recognition and Postural Assessment

Spatio-temporal neural network with handcrafted features for skeleton-based action recognition

Spatial-temporal graph neural ODE networks for skeleton-based action recognition

Local Spherical Harmonics Improve Skeleton-Based Hand Action Recognition

Spatiotemporal Progressive Inward-Outward Aggregation Network for skeleton-based action recognition

Application of Gesture Recognition Based on Spatiotemporal Graph Convolution Network in Virtual Reality Interaction

Hand-object reconstruction via interaction-aware graph attention mechanism

Spatial-Temporal Attention Res-TCN for Skeleton-Based Dynamic Hand Gesture Recognition