Abstract:Anomaly detection has significant importance for the development of autonomous monitoring systems. Real-world anomalous events are complicated due to diverse human behaviors and class variations. Anomalous activities depend upon speed, length of activity, and motion features to comprehend suspicious behaviors. Fast activities are captured quickly within a few video frames, whereas slow actions may take several hundred video frames to define an anomalous action. Furthermore, a video is more than just a stack of frames with spatiotemporal representations. Most of the existing approaches suffer from learning variable speed fast and slow activities simultaneously and primarily focus on learning spatiotemporal features only. Modeling the spatiotemporal and motion relationships between frames together can help understand the actions better. Motion features when combined with spatiotemporal representations perform higher. Our contribution is two-fold in this research work. Firstly, a novel dynamic frame-skipping approach is proposed to duly generate meaningful representations of spatiotemporal frames and optical-flow-based motion representations for variable speed anomalous actions. Secondly, AnomalyNet, as a new end-to-end deep architecture, is designed to simultaneously learn both spatiotemporal and motion features in image sequences. AnomalyNet is evaluated on the challenging real-world anomaly detection datasets. The results confirm that the proposed model has achieved a competitive AUC of 86.1% on the real-world UCF-Crime dataset and has achieved a superior AUC score of 99.87% compared to state-of-the-art methods on challenging ShanghaiTech dataset in the domain of unsupervised, weakly-supervised, and fully-supervised anomaly detection. Furthermore, the model achieved the highest F1 score for both fast and slow variable speed anomalous activities, such as explosions, road accidents, robbery, and stealing for real-world autonomous surveillance.

Enhanced Anomaly Detection in Dashcam Videos: Dual GAN Approach with Swin-Unet for Optical Flow and Region of Interest Analysis

Anomaly Detection in Traffic Surveillance Videos with GAN-based Future Frame Prediction

Anomaly Candidate Identification and Starting Time Estimation of Vehicles from Traffic Videos.

Towards Anomaly Detection in Dashcam Videos

Video Anomaly Detection using GAN

What goes around comes around: Cycle-Consistency-based Short-Term Motion Prediction for Anomaly Detection using Generative Adversarial Networks

Dual GroupGAN: An unsupervised four-competitor (2V2) approach for video anomaly detection

Multi-Channel Generative Framework and Supervised Learning for Anomaly Detection in Surveillance Videos

Anomaly Detection in Traffic Scenes via Spatial-aware Motion Reconstruction

Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detection

Driving Anomaly Detection Using Conditional Generative Adversarial Network

Anomaly Event Detection in Security Surveillance Using Two-Stream Based Model

Dual contrast discriminator with sharing attention for video anomaly detection

Channel based approach via faster dual prediction network for video anomaly detection

Video Anomaly Detection Based on Global–Local Convolutional Autoencoder

Unsupervised Traffic Accident Detection in First-Person Videos

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

AnomalyNet: a spatiotemporal motion-aware CNN approach for detecting anomalies in real-world autonomous surveillance

Video anomaly detection and localization via Gaussian Mixture Fully Convolutional Variational Autoencoder

3D U-Net for Video Anomaly Detection.