Abstract:Abnormal event detection in large videos is an important task in research and industrial applications, which has attracted considerable attention in recent years. Existing methods usually solve this problem by extracting local features and then learning an outlier detection model on training videos. However, most previous approaches merely employ hand-crafted visual features, which is a clear disadvantage due to their limited representation capacity. In this paper, we present a novel unsupervised deep feature learning algorithm for the abnormal event detection problem. To exploit the spatiotemporal information of the inputs, we utilize the deep three-dimensional convolutional network (C3D) to perform feature extraction. Then, the key problem is how to train the C3D network without any category labels. Here, we employ the sparse coding results of the hand-crafted features generated from the inputs to guide the unsupervised feature learning. Specifically, we define a multilevel similarity relationship between these inputs according to the statistical information of the shared atoms. In the following, we introduce the quadruplet concept to model the multilevel similarity structure, which could be used to construct a generalized triplet loss for training the C3D network. Furthermore, the C3D network could be utilized to generate the features for sparse coding again, and this pipeline could be iterated for several times. By jointly optimizing between the sparse coding and the unsupervised feature learning, we can obtain robust and rich feature representations. Based on the learned representations, the sparse reconstruction error is applied to predicting the anomaly score of each testing input. Experiments on several publicly available video surveillance datasets in comparison with a number of existing works demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.

Pair-wise event detection using cubic features and sequence discriminant learning

PKU@TRECVID2010: Pair-Wise Event Detection in Surveillance Video.

A System Based On Sequence Learning For Event Detection In Surveillance Video

Fine-Grained Urban Event Detection and Characterization Based on Tensor Cofactorization

PKU-NEC @TRECVID2012 SED - Uneven-Sequence Based Event Detection in Surveillance Video.

Detecting Rare Actions and Events from Surveillance Big Data with Bag of Dynamic Trajectories

Sparse Coding Guided Spatiotemporal Feature Learning for Abnormal Event Detection in Large Videos

Effective video event detection via subspace projection

Learning Spatiotemporal Features via Video and Text Pair Discrimination

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Interactive Surveillance Event Detection through Mid-level Discriminative Representation

Semi-supervised Early Event Detection.

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Multimodal feature fusion for robust event detection in web videos

Discovering Latent Discriminative Patterns for Multi-Mode Event Representation.

A Discriminative CNN Video Representation for Event Detection.

Complex Event Detection by Identifying Reliable Shots from Untrimmed Videos

PKU@TRECVID2009: Single-Actor and Pair-Activity Event Detection in Surveillance Video

Columbia-UCF TRECVID2010 Multimedia Event Detection: Combining Multiple Modalities, Contextual Concepts, and Temporal Matching.

Multi-Instance Dictionary Learning For Detecting Abnormal Events In Surveillance Videos

Video interaction event analysis method and device base on sequence space-time cube characteristics