Abstract:Abnormal event detection in large videos is an important task in research and industrial applications, which has attracted considerable attention in recent years. Existing methods usually solve this problem by extracting local features and then learning an outlier detection model on training videos. However, most previous approaches merely employ hand-crafted visual features, which is a clear disadvantage due to their limited representation capacity. In this paper, we present a novel unsupervised deep feature learning algorithm for the abnormal event detection problem. To exploit the spatiotemporal information of the inputs, we utilize the deep three-dimensional convolutional network (C3D) to perform feature extraction. Then, the key problem is how to train the C3D network without any category labels. Here, we employ the sparse coding results of the hand-crafted features generated from the inputs to guide the unsupervised feature learning. Specifically, we define a multilevel similarity relationship between these inputs according to the statistical information of the shared atoms. In the following, we introduce the quadruplet concept to model the multilevel similarity structure, which could be used to construct a generalized triplet loss for training the C3D network. Furthermore, the C3D network could be utilized to generate the features for sparse coding again, and this pipeline could be iterated for several times. By jointly optimizing between the sparse coding and the unsupervised feature learning, we can obtain robust and rich feature representations. Based on the learned representations, the sparse reconstruction error is applied to predicting the anomaly score of each testing input. Experiments on several publicly available video surveillance datasets in comparison with a number of existing works demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.

Multi-Stream 3D Latent Feature Clustering for Abnormality Detection in Videos

Anomaly3D: Video Anomaly Detection Based on 3D-Normality Clusters

Unsupervised Feature Based Abnormality Detection

Sparse Coding Guided Spatiotemporal Feature Learning for Abnormal Event Detection in Large Videos

Multi Chunk Learning Based Auto Encoder for Video Anomaly Detection

Two‐stage video anomaly detection based on dual‐stream networks and multi‐instance learning

Abnormal Event Detection in Surveillance Videos Based on Multi-Scale Feature and Channel-Wise Attention Mechanism

Detecting Abnormal Behaviors in Surveillance Videos Based on Fuzzy Clustering and Multiple Auto-Encoders

Video Anomaly Detection Based on 3D Convolutional Auto-Encoder

Detection Anomaly in Video Based on Deep Support Vector Data Description

An Improved Two-stream Inflated 3D ConvNet for Abnormal Behavior Detection

Detecting Abnormality without Knowing Normality: A Two-stage Approach for Unsupervised Video Abnormal Event Detection.

Learning Appearance-motion Normality for Video Anomaly Detection.

Detecting abnormal events in video using Narrowed Normality Clusters

Abnormal Events Detection Method for Surveillance Video Using an Improved Autoencoder with Multi-Modal Input

Abnormal Event Detection Based on Multi-scale Markov Random Field.

Deep Appearance Features for Abnormal Behavior Detection in Video

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Deep learning based anomaly detection in real-time video

Abnormal event detection via the analysis of multi-frame optical flow information

Adversarial 3D Convolutional Auto-Encoder for Abnormal Event Detection in Videos.