Abstract:Anomaly detection has significant importance for the development of autonomous monitoring systems. Real-world anomalous events are complicated due to diverse human behaviors and class variations. Anomalous activities depend upon speed, length of activity, and motion features to comprehend suspicious behaviors. Fast activities are captured quickly within a few video frames, whereas slow actions may take several hundred video frames to define an anomalous action. Furthermore, a video is more than just a stack of frames with spatiotemporal representations. Most of the existing approaches suffer from learning variable speed fast and slow activities simultaneously and primarily focus on learning spatiotemporal features only. Modeling the spatiotemporal and motion relationships between frames together can help understand the actions better. Motion features when combined with spatiotemporal representations perform higher. Our contribution is two-fold in this research work. Firstly, a novel dynamic frame-skipping approach is proposed to duly generate meaningful representations of spatiotemporal frames and optical-flow-based motion representations for variable speed anomalous actions. Secondly, AnomalyNet, as a new end-to-end deep architecture, is designed to simultaneously learn both spatiotemporal and motion features in image sequences. AnomalyNet is evaluated on the challenging real-world anomaly detection datasets. The results confirm that the proposed model has achieved a competitive AUC of 86.1% on the real-world UCF-Crime dataset and has achieved a superior AUC score of 99.87% compared to state-of-the-art methods on challenging ShanghaiTech dataset in the domain of unsupervised, weakly-supervised, and fully-supervised anomaly detection. Furthermore, the model achieved the highest F1 score for both fast and slow variable speed anomalous activities, such as explosions, road accidents, robbery, and stealing for real-world autonomous surveillance.

Self-Attention Memory-Augmented Wavelet-CNN for Anomaly Detection

An Unsupervised Framework for Anomaly Detection in a Water Treatment System

CANet: Convolutional Attention-based Network for Multivariate Time Series Anomaly Detection

A Diffusion-Based Framework for Multi-Class Anomaly Detection

Adjacent Image Augmentation and Its Framework for Self-Supervised Learning in Anomaly Detection

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Spatial-contextual variational autoencoder with attention correction for anomaly detection in retinal OCT images

Anomaly detection in surveillance videos using Transformer with margin learning

Multimodal Attention-Enhanced Feature Fusion-based Weekly Supervised Anomaly Violence Detection

AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

AnomalyNet: a spatiotemporal motion-aware CNN approach for detecting anomalies in real-world autonomous surveillance

Memory-Augmented Spatial-Temporal Consistency Network for Video Anomaly Detection.

Research of Anomaly detection based on Dynamic Anomaly Detection Enhancement Framework

Anomaly Detection for Automated Vehicles Integrating Continuous Wavelet Transform and Convolutional Neural Network

Adaptive Memory Networks With Self-Supervised Learning for Unsupervised Anomaly Detection

Hierarchical Context Representation and Self-adaptive Thresholding for Multivariate Anomaly Detection

Unsupervised Anomaly Detection in Medical Images with a Memory-augmented Multi-level Cross-attentional Masked Autoencoder

Video Anomaly Detection Based on Attention Mechanism

Object-Guided and Motion-Refined Attention Network for Video Anomaly Detection