Abstract:Detection of abnormal behavior in surveillance videos is essential for public safety and monitoring. However, it needs constant human focus and attention for human-based surveillance systems, which is a challenging process. Therefore, automatic detection of such events is of great significance. Abnormal event detection is a challenging problem due to the scarceness of labelled data and the low probability of occurrence of such events. In this paper, we propose a novel multi-stream two-stage architecture to detect abnormal behavior in videos. Our contributions are three-fold: 1) In the first stage, we propose a 3D Convolutional Autoencoder (3DCAE) architecture for appearance and motion feature extraction from both video frame input and dynamic flow input streams of normal event training videos in an unsupervised manner. 2) We have used a multi-objective loss function for 3DCAE reconstruction which can focus more on foreground moving objects rather that the stationary background information. 3) In the second stage, the fused latent features from both video frames and dynamic flow inputs are grouped together into different clusters of normality. Then we eliminate the smaller or sparse clusters, which are supposed to contain noisy patterns in the training data, to represent stronger normality patterns. A Deep one-class Support Vector Data Description (SVDD) classifier is then trained on these 3D normality clusters to generate anomaly scores for each sample in 3D clusters to differentiate between normal and abnormal occurrences. Experimental results on three benchmarking datasets: UCSD Pedestrian, Shanghai Tech, and Avenue, show significant improvement in the performance compared to the state-of-the-art approaches.

Joint Abnormal Blob Detection and Localization Under Complex Scenes

Online Detection of Abnormal Events in Video Streams

Abnormal Global and Local Event Detection in Compressive Sensing Domain

Context-aware Local Abnormality Detection in Crowded Scene

Abnormal Behavior Detection Based on Regional Optical Flow

Abnormal Event Detection Via Covariance Matrix for Optical Flow Based Feature.

Anomaly Detection and Localization in Crowded Scenes by Motion-field Shape Description and Similarity-based Statistical Learning

Abnormal Event Detection Based on Analysis of Movement Information of Video Sequence

Detection of Visual Abnormal Events via One-class SVM

Abnormal Event Detection Using Spatio-Temporal Feature and Nonnegative Locality-Constrained Linear Coding.

Anomaly Detection and Localisation in the Crowd Scenes Using a Block-Based Social Force Model

Real-Time Abnormal Event Detection in Complicated Scenes

Fast and accurate detection and localization of abnormal behavior in crowded scenes

Online Least Squares One-Class Support Vector Machines-Based Abnormal Visual Event Detection.

Abnormal Event Detection Based on Multi-scale Markov Random Field.

An Object-Aware Anomaly Detection and Localization in Surveillance Videos.

Abnormal Event Detection Via Multikernel Learning for Distributed Camera Networks

Anomalous Situation Detection in Complex Scenes

Multi-Stream 3D Latent Feature Clustering for Abnormality Detection in Videos

Sparse representation for robust abnormality detection in crowded scenes

Abnormal Event Detection and Location for Dense Crowds using Repulsive Forces and Sparse Reconstruction