Abstract:Anomaly detection has significant importance for the development of autonomous monitoring systems. Real-world anomalous events are complicated due to diverse human behaviors and class variations. Anomalous activities depend upon speed, length of activity, and motion features to comprehend suspicious behaviors. Fast activities are captured quickly within a few video frames, whereas slow actions may take several hundred video frames to define an anomalous action. Furthermore, a video is more than just a stack of frames with spatiotemporal representations. Most of the existing approaches suffer from learning variable speed fast and slow activities simultaneously and primarily focus on learning spatiotemporal features only. Modeling the spatiotemporal and motion relationships between frames together can help understand the actions better. Motion features when combined with spatiotemporal representations perform higher. Our contribution is two-fold in this research work. Firstly, a novel dynamic frame-skipping approach is proposed to duly generate meaningful representations of spatiotemporal frames and optical-flow-based motion representations for variable speed anomalous actions. Secondly, AnomalyNet, as a new end-to-end deep architecture, is designed to simultaneously learn both spatiotemporal and motion features in image sequences. AnomalyNet is evaluated on the challenging real-world anomaly detection datasets. The results confirm that the proposed model has achieved a competitive AUC of 86.1% on the real-world UCF-Crime dataset and has achieved a superior AUC score of 99.87% compared to state-of-the-art methods on challenging ShanghaiTech dataset in the domain of unsupervised, weakly-supervised, and fully-supervised anomaly detection. Furthermore, the model achieved the highest F1 score for both fast and slow variable speed anomalous activities, such as explosions, road accidents, robbery, and stealing for real-world autonomous surveillance.

Jaywalking detection and localization in street scene videos using fine-tuned convolutional neural networks

Segmentation Based Real Time Anomaly Detection and Tracking Model for Pedestrian Walkways

Spatial-temporal Convolutional Neural Networks for Anomaly Detection and Localization in Crowded Scenes

Small-Scale Urban Object Anomaly Detection Using Convolutional Neural Networks with Probability Estimation

Mask Region Based Convolution Neural Network (R-CNN) based Smart System for Anomaly Detection in Pedestrian Walkways

Anomalous Behaviors Detection in Moving Crowds Based on a Weighted Convolutional Autoencoder-Long Short-Term Memory Network

Video Anomaly Detection and Localization Based on an Adaptive Intra-Frame Classification Network

Anomaly Detection Based on a 3D Convolutional Neural Network Combining Convolutional Block Attention Module Using Merged Frames

Enhancing Anomaly Detection in Pedestrian Walkways using Improved Sparrow Search Algorithm with Parallel Features Fusion Model

A-VAE: Attention based Variational Autoencoder for Traffic Video Anomaly Detection

A Dataset and Model for Crossing Indian Roads

Video Trajectory Classification and Anomaly Detection Using Hybrid CNN-VAE

An Efficient CNN and BI-LSTM Model for Abnormal Event Detection in Video Surveillance

Sequential Attention Mechanism for Weakly Supervised Video Anomaly Detection

Deep learning based anomaly detection in real-time video

An Abnormal Behavior Detection Method of Video Crowds and Vehicles Based on Deep Learning

CVAD-GAN: Constrained video anomaly detection via generative adversarial network

AnomalyNet: a spatiotemporal motion-aware CNN approach for detecting anomalies in real-world autonomous surveillance

Anomaly Detection in Automated Vehicles Using Multistage Attention-Based Convolutional Neural Network

Video Anomaly Detection Based on Global–Local Convolutional Autoencoder