Abstract:Real-time Human action classification in complex scenes has applications in various domains such as visual surveillance, video retrieval and human robot interaction. While, the task is challenging due to computation efficiency, cluttered backgrounds and intro-variability among same type of actions. Spatio-temporal interest point (STIP) based methods have shown promising results to tackle human action classification in complex scenes efficiently. However, the state-of-the-art works typically utilize bag-of-visual words (BoVW) model which only focuses on the word distribution of STIPs and ignore the distinctive character of word structure. In this paper, the distribution of STIPs is organized into a salient directed graph, which reflects salient motions and can be divided into a time salient directed graph and a space salient directed graph, aiming at adding spatio-temporal discriminant to BoVW. Generally speaking, both salient directed graphs are constructed by labeled STIPs in pairs. In detail, the "directional co-occurrence" property of different labeled pairwise STIPs in same frame is utilized to represent the time saliency, and the space saliency is reflected by the "geometric relationships" between same labeled pairwise STIPs across different frames. Then, new statistical features namely the Time Salient Pairwise feature (TSP) and the Space Salient Pairwise feature (SSP) are designed to describe two salient directed graphs, respectively. Experiments are carried out with a homogeneous kernel SVM classifier, on four challenging datasets KTH, ADL and UT-Interaction. Final results confirm the complementary of TSP and SSP, and our multi-cue representation TSP + SSP + BoVW can properly describe human actions with large intro-variability in real-time. Copyright (C) 2016, Chongqing University of Technology. Production and hosting by Elsevier B.V.

THRESHOLD DYNAMIC TIME WARPING FOR SPATIAL ACTIVITY RECOGNITION

A Smith-Waterman Local Alignment Approach for Spatial Activity Recognition

Expert enhanced dynamic time warping based anomaly detection

Learning Discriminative Prototypes with Dynamic Time Warping

Recognising Online Spatial Activities Using a Bioinformatics Inspired Sequence Alignment Approach

Human Activity Prediction Using Temporally-Weighted Generalized Time Warping

mnmDTW: An extension to Dynamic Time Warping for Camera-based Movement Error Localization

Spatio-Temporal Triangular-Chain Crf For Activity Recognition

Recognizing Human Activities by Key Frame in Video Sequences.

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Dynamic Thresholding for Video Anomaly Detection

Sparsification of the Alignment Path Search Space in Dynamic Time Warping

Spatial-temporal activity interactions detection in video survalliance

Human action recognition for 3D video based on action standard sequence

Salient Pairwise Spatio-Temporal Interest Points for Real-Time Activity Recognition.

A Dynamic Hand Gesture Recognition Model Based on the Improved Dynamic Time Warping Algorithm.

A Hierarchical Spatio-Temporal Model for Human Activity Recognition.

Head Gesture Recognition Combining Activity Detection and Dynamic Time Warping

Gait Recognition Via Flexible Measurement

A Pursuit of Temporal Accuracy in General Activity Detection.

Invariant subspace learning for time series data based on dynamic time warping distance