Abstract:Anomaly detection has significant importance for the development of autonomous monitoring systems. Real-world anomalous events are complicated due to diverse human behaviors and class variations. Anomalous activities depend upon speed, length of activity, and motion features to comprehend suspicious behaviors. Fast activities are captured quickly within a few video frames, whereas slow actions may take several hundred video frames to define an anomalous action. Furthermore, a video is more than just a stack of frames with spatiotemporal representations. Most of the existing approaches suffer from learning variable speed fast and slow activities simultaneously and primarily focus on learning spatiotemporal features only. Modeling the spatiotemporal and motion relationships between frames together can help understand the actions better. Motion features when combined with spatiotemporal representations perform higher. Our contribution is two-fold in this research work. Firstly, a novel dynamic frame-skipping approach is proposed to duly generate meaningful representations of spatiotemporal frames and optical-flow-based motion representations for variable speed anomalous actions. Secondly, AnomalyNet, as a new end-to-end deep architecture, is designed to simultaneously learn both spatiotemporal and motion features in image sequences. AnomalyNet is evaluated on the challenging real-world anomaly detection datasets. The results confirm that the proposed model has achieved a competitive AUC of 86.1% on the real-world UCF-Crime dataset and has achieved a superior AUC score of 99.87% compared to state-of-the-art methods on challenging ShanghaiTech dataset in the domain of unsupervised, weakly-supervised, and fully-supervised anomaly detection. Furthermore, the model achieved the highest F1 score for both fast and slow variable speed anomalous activities, such as explosions, road accidents, robbery, and stealing for real-world autonomous surveillance.

Crowd Anomaly Detection in Video Frames Using Fine-Tuned AlexNet Model

Optimized deep maxout for crowd anomaly detection: A hybrid optimization-based model

Deep-Anomaly: Fully Convolutional Neural Network for Fast Anomaly Detection in Crowded Scenes

Unsupervised fast anomaly detection in crowds.

Anomaly Detection and Localisation in the Crowd Scenes Using a Block-Based Social Force Model

Anomaly Detection Based on a 3D Convolutional Neural Network Combining Convolutional Block Attention Module Using Merged Frames

Video anomaly detection based on scene classification

Video Anomaly Detection and Localization Based on an Adaptive Intra-Frame Classification Network

An Adaptive Training-less System for Anomaly Detection in Crowd Scenes

Anomaly Detection for Videos of Crowded Scenes Based on Optical Flow Information

Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Prediction

Robust Unsupervised Video Anomaly Detection by Multipath Frame Prediction

Spatial-temporal Convolutional Neural Networks for Anomaly Detection and Localization in Crowded Scenes

AnomalyNet: a spatiotemporal motion-aware CNN approach for detecting anomalies in real-world autonomous surveillance

Plug-and-Play Anomaly Detection with Expectation Maximization Filtering

AED-Net: An Abnormal Event Detection Network

Detecting and Quantifying Crowd-Level Abnormal Behaviors in Crowd Events

Anomaly Detection Based on Spatio-Temporal Sparse Representation and Visual Attention Analysis.

Fast and accurate detection and localization of abnormal behavior in crowded scenes

Enhancement of Video Anomaly Detection Performance Using Transfer Learning and Fine-Tuning