Abstract:ABSTRACTEvent detection plays an essential role in video content analysis and remains a challenging open problem. In particular, the study on detecting human-related video events in complex scenes with both a crowd of people and dynamic motion is still limited. In this paper, we investigate detecting video events that involve elementary human actions, e.g. making cellphone call, putting an object down, and pointing to something, in complex scenes using a novel spatio-temporal descriptor based approach. A new spatio-temporal descriptor, which temporally integrates the statistics of a set of response maps of low-level features, e.g. image gradients and optical flows, in a space-time cube, is proposed to capture the characteristics of actions in terms of their appearance and motion patterns. Based on this kind of descriptors, the bag-of-words method is utilized to describe a human figure as a concise feature vector. Then, these features are employed to train SVM classifiers at multiple spatial pyramid levels to distinguish different actions. Finally, a Gaussian kernel based temporal filtering is conducted to segment the sequences of events from a video stream taking account of the temporal consistency of actions. The proposed approach is capable of tolerating spatial layout variations and local deformations of human actions due to diverse view angles and rough human figure alignment in complex scenes. Extensive experiments on the 50-hour video dataset of TRECVid 2008 event detection task demonstrate that our approach outperforms the well-known SIFT descriptor based methods and effectively detects video events in challenging real-world conditions.

A Fast Sub-Volume Search Method for Human Action Detection

A Method of Simultaneously Action Recognition and Video Segmentation of Video Streams.

Efficient human action detection: a coarse-to-fine strategy

Fast and Unsupervised Action Boundary Detection for Action Segmentation

Human Action Detection Via Boosted Local Motion Histograms

Action Recognition Based on A Selective Sampling Strategy for Real-Time Video Surveillance

Unsupervised Human Action Detection by Action Matching

Fast Action Detection with One Query Example Based on Hough Voting.

Action Recognition by Mid-Level Discriminative Spatial-Temporal Volume

One Example Based Action Detection in Hough Space

An Improved Interest Point Detector for Human Action Recognition

Locating and Recognizing Multiple Human Actions by Searching for Maximum Score Subsequences

Fast and Accurate Action Detection in Videos With Motion-Centric Attention Model

Action Detection in Complex Scenes with Spatial and Temporal Ambiguities

Human Action Recognition using Salient Region Detection in Complex Scenes

Searching Action Proposals Via Spatial Actionness Estimation And Temporal Path Inference And Tracking

Learning Spatial and Temporal Extents of Human Actions for Action Detection

Action Recognition in Video Using Human Keypoint Detection

Human Action Retrieval via Spatio-temporal Cuboids

Human Action Detection by Boosting Efficient Motion Features.

Detecting video events based on action recognition in complex scenes using spatio-temporal descriptor.