Abstract:Abnormal event detection in large videos is an important task in research and industrial applications, which has attracted considerable attention in recent years. Existing methods usually solve this problem by extracting local features and then learning an outlier detection model on training videos. However, most previous approaches merely employ hand-crafted visual features, which is a clear disadvantage due to their limited representation capacity. In this paper, we present a novel unsupervised deep feature learning algorithm for the abnormal event detection problem. To exploit the spatiotemporal information of the inputs, we utilize the deep three-dimensional convolutional network (C3D) to perform feature extraction. Then, the key problem is how to train the C3D network without any category labels. Here, we employ the sparse coding results of the hand-crafted features generated from the inputs to guide the unsupervised feature learning. Specifically, we define a multilevel similarity relationship between these inputs according to the statistical information of the shared atoms. In the following, we introduce the quadruplet concept to model the multilevel similarity structure, which could be used to construct a generalized triplet loss for training the C3D network. Furthermore, the C3D network could be utilized to generate the features for sparse coding again, and this pipeline could be iterated for several times. By jointly optimizing between the sparse coding and the unsupervised feature learning, we can obtain robust and rich feature representations. Based on the learned representations, the sparse reconstruction error is applied to predicting the anomaly score of each testing input. Experiments on several publicly available video surveillance datasets in comparison with a number of existing works demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.

Unusual Events Detection Based on Multi-Dictionary Sparse Representation Using Kinect

A Constrained Self-adaptive Sparse Combination Representation Method for Abnormal Event Detection.

Sparse Coding Guided Spatiotemporal Feature Learning for Abnormal Event Detection in Large Videos

Exploiting the Sparse Characteristics in Probabilistic Feature Space for Hyperspectral Anomaly Detection

Tracking in Multimedia Data Via Robust Reweighted Local Multi-Task Sparse Representation for Transportation Surveillance

Learning Spatio-Temporal Relations with Multi-Scale Integrated Perception for Video Anomaly Detection

Abnormal Events Detection Using Deep Networks for Video Surveillance.

Video abnormal event detection based on fast sparse coding and surprise computation

Abnormal Event Detection in Crowded Scenes Using Two Sparse Dictionaries with Saliency

Abnormal Event Detection Based on Multi-scale Markov Random Field.

Abnormal Event Detection in Surveillance Videos Based on Low-Rank and Compact Coefficient Dictionary Learning

Deep learning based anomaly detection in real-time video

Learning to Detect Anomalies in Surveillance Video.

Anomaly Detection Via Local Coordinate Factorization And Spatio-Temporal Pyramid

Unusual event detection in crowded scenes by trajectory analysis

Abnormal Event Detection Using Spatio-Temporal Feature and Nonnegative Locality-Constrained Linear Coding.

Discriminative Object Tracking Via Sparse Representation and Online Dictionary Learning

Multi-Instance Dictionary Learning For Detecting Abnormal Events In Surveillance Videos

Anomaly Detection Based on Spatio-Temporal Sparse Representation and Visual Attention Analysis.

Abnormal event detection via multi-instance dictionary learning

Learning Sparse Representation With Variational Auto-Encoder for Anomaly Detection.