Abstract:Detection of abnormal behavior in surveillance videos is essential for public safety and monitoring. However, it needs constant human focus and attention for human-based surveillance systems, which is a challenging process. Therefore, automatic detection of such events is of great significance. Abnormal event detection is a challenging problem due to the scarceness of labelled data and the low probability of occurrence of such events. In this paper, we propose a novel multi-stream two-stage architecture to detect abnormal behavior in videos. Our contributions are three-fold: 1) In the first stage, we propose a 3D Convolutional Autoencoder (3DCAE) architecture for appearance and motion feature extraction from both video frame input and dynamic flow input streams of normal event training videos in an unsupervised manner. 2) We have used a multi-objective loss function for 3DCAE reconstruction which can focus more on foreground moving objects rather that the stationary background information. 3) In the second stage, the fused latent features from both video frames and dynamic flow inputs are grouped together into different clusters of normality. Then we eliminate the smaller or sparse clusters, which are supposed to contain noisy patterns in the training data, to represent stronger normality patterns. A Deep one-class Support Vector Data Description (SVDD) classifier is then trained on these 3D normality clusters to generate anomaly scores for each sample in 3D clusters to differentiate between normal and abnormal occurrences. Experimental results on three benchmarking datasets: UCSD Pedestrian, Shanghai Tech, and Avenue, show significant improvement in the performance compared to the state-of-the-art approaches.

A New Approach For Extracting And Summarizing Abnormal Activities In Surveillance Videos

Summarizing Surveillance Videos with Local-Patch-learning-based Abnormality Detection, Blob Sequence Optimization, and Type-Based Synopsis

Creating Memorable Video Summaries That Satisfy the User's Intention for Taking the Videos.

A Representative-Based Framework For Parsing And Summarizing Events In Surveillance Videos

Event-based Large Scale Surveillance Video Summarization.

Abnormal Behavior Detection Based on Target Analysis

Automatic Video Summarization by Spatio-temporal Analysis and Non-trivial Repeating Pattern Detection

Hierarchical Video Summarization with Loitering Indication

Video Summarization Via Cluster-Based Object Tracking and Type-Based Synopsis

A novel approach for enhanced abnormal action recognition via coarse and precise detection stage

An Intelligent Video Analysis Method for Abnormal Event Detection in Intelligent Transportation Systems

Detecting Abnormal Behaviors in Surveillance Videos Based on Fuzzy Clustering and Multiple Auto-Encoders

Unsupervised Synthesis of Anomalies in Videos: Transforming the Normal

An Object-Aware Anomaly Detection and Localization in Surveillance Videos.

Intelligent approach for analyzing surveillance videos in urban emergency management

Surveillance video synopsis framework base on tube set

Abnormal Activity Detection Using Spatio-Temporal Feature and Laplacian Sparse Representation.

Video Behavior Analysis Using Topic Models and Rough Sets [applications Notes]

Abnormal Events Detection Using Deep Networks for Video Surveillance.

On improving behavior subtraction

Multi-Stream 3D Latent Feature Clustering for Abnormality Detection in Videos