Abstract:Anomaly detection has significant importance for the development of autonomous monitoring systems. Real-world anomalous events are complicated due to diverse human behaviors and class variations. Anomalous activities depend upon speed, length of activity, and motion features to comprehend suspicious behaviors. Fast activities are captured quickly within a few video frames, whereas slow actions may take several hundred video frames to define an anomalous action. Furthermore, a video is more than just a stack of frames with spatiotemporal representations. Most of the existing approaches suffer from learning variable speed fast and slow activities simultaneously and primarily focus on learning spatiotemporal features only. Modeling the spatiotemporal and motion relationships between frames together can help understand the actions better. Motion features when combined with spatiotemporal representations perform higher. Our contribution is two-fold in this research work. Firstly, a novel dynamic frame-skipping approach is proposed to duly generate meaningful representations of spatiotemporal frames and optical-flow-based motion representations for variable speed anomalous actions. Secondly, AnomalyNet, as a new end-to-end deep architecture, is designed to simultaneously learn both spatiotemporal and motion features in image sequences. AnomalyNet is evaluated on the challenging real-world anomaly detection datasets. The results confirm that the proposed model has achieved a competitive AUC of 86.1% on the real-world UCF-Crime dataset and has achieved a superior AUC score of 99.87% compared to state-of-the-art methods on challenging ShanghaiTech dataset in the domain of unsupervised, weakly-supervised, and fully-supervised anomaly detection. Furthermore, the model achieved the highest F1 score for both fast and slow variable speed anomalous activities, such as explosions, road accidents, robbery, and stealing for real-world autonomous surveillance.

TSAN: A New Deep Learning-Based Detection Method for Sensor Anomaly in Mobile Robots

Proactive Anomaly Detection for Robot Navigation with Multi-Sensor Fusion

TA-NET: Empowering Highly Efficient Traffic Anomaly Detection Through Multi-Head Local Self-Attention and Adaptive Hierarchical Feature Reconstruction

GAN-based Data Augmentation Strategy for Sensor Anomaly Detection in Industrial Robots

DTAAD: Dual Tcn-Attention Networks for Anomaly Detection in Multivariate Time Series Data

Anomaly Detection for Robust Autonomous Navigation.

Anomaly Detection for Data from Unmanned Systems via Improved Graph Neural Networks with Attention Mechanism

Asymmetric Anomaly Detection for Human-Robot Interaction

Fine-Grained Multivariate Time Series Anomaly Detection in IoT

AnomalyNet: a spatiotemporal motion-aware CNN approach for detecting anomalies in real-world autonomous surveillance

Video Anomaly Detection Based on Attention Mechanism

TimeTector: A Twin-Branch Approach for Unsupervised Anomaly Detection in Livestock Sensor Noisy Data (TT-TBAD)

Anomaly detection using spatial and temporal information in multivariate time series

Temporally Identity-Aware SSD With Attentional LSTM

An Effective Transformation-Encoding-Attention Framework for Multivariate Time Series Anomaly Detection in IoT Environment

Robust Learning of Deep Time Series Anomaly Detection Models with Contaminated Training Data

WKN-OC: A New Deep Learning Method for Anomaly Detection in Intelligent Vehicles

TSMAE: A Novel Anomaly Detection Approach for Internet of Things Time Series Data Using Memory-Augmented Autoencoder

TS-PADM: Anomaly Detection Model of Wireless Sensors Based on Spatial-Temporal Feature Points