Abstract:Anomaly detection has significant importance for the development of autonomous monitoring systems. Real-world anomalous events are complicated due to diverse human behaviors and class variations. Anomalous activities depend upon speed, length of activity, and motion features to comprehend suspicious behaviors. Fast activities are captured quickly within a few video frames, whereas slow actions may take several hundred video frames to define an anomalous action. Furthermore, a video is more than just a stack of frames with spatiotemporal representations. Most of the existing approaches suffer from learning variable speed fast and slow activities simultaneously and primarily focus on learning spatiotemporal features only. Modeling the spatiotemporal and motion relationships between frames together can help understand the actions better. Motion features when combined with spatiotemporal representations perform higher. Our contribution is two-fold in this research work. Firstly, a novel dynamic frame-skipping approach is proposed to duly generate meaningful representations of spatiotemporal frames and optical-flow-based motion representations for variable speed anomalous actions. Secondly, AnomalyNet, as a new end-to-end deep architecture, is designed to simultaneously learn both spatiotemporal and motion features in image sequences. AnomalyNet is evaluated on the challenging real-world anomaly detection datasets. The results confirm that the proposed model has achieved a competitive AUC of 86.1% on the real-world UCF-Crime dataset and has achieved a superior AUC score of 99.87% compared to state-of-the-art methods on challenging ShanghaiTech dataset in the domain of unsupervised, weakly-supervised, and fully-supervised anomaly detection. Furthermore, the model achieved the highest F1 score for both fast and slow variable speed anomalous activities, such as explosions, road accidents, robbery, and stealing for real-world autonomous surveillance.

A Fast Anomaly Diagnosis Approach Based on Modified CNN and Multi-Sensor Data Fusion

Data anomaly detection for structural health monitoring using a combination network of GANomaly and CNN

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

Rolling Bearing Fault Diagnosis Using Multi-Sensor Data Fusion Based on 1D-CNN Model

AnomalyNet: a spatiotemporal motion-aware CNN approach for detecting anomalies in real-world autonomous surveillance

CANet: Convolutional Attention-based Network for Multivariate Time Series Anomaly Detection

Global contextual feature aggregation networks with multiscale attention mechanism for mechanical fault diagnosis under non-stationary conditions

A convolutional multisensor fusion fault diagnosis framework based on multidimensional distance matrix for rotating machinery

Magnetic Anomaly Detection Using One-Dimensional Convolutional Neural Network With Multi-Feature Fusion

Application of Multiscale Learning Neural Network Based on CNN in Bearing Fault Diagnosis

Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals

A Rotating Machinery Fault Diagnosis Method Based on Multi-Sensor Fusion and ECA-CNN

Multiclass anomaly detection in imbalanced structural health monitoring data using convolutional neural network

Time-varying speed fault diagnosis based on dual-channel parallel multi-scale information

A Generic Intelligent Bearing Fault Diagnosis System Using Compact Adaptive 1D CNN Classifier

Multiattention-Based Feature Aggregation Convolutional Networks with Dual Focal Loss for Fault Diagnosis of Rotating Machinery under Data Imbalance Conditions

A Novel Deep Learning Method for Intelligent Fault Diagnosis of Rotating Machinery Based on Improved CNN-SVM and Multichannel Data Fusion

Cross-modal Fusion Convolutional Neural Networks with Online Soft Label Training Strategy for Mechanical Fault Diagnosis

A Bearing Fault Diagnosis Method Based on Spectrum Map Information Fusion and Convolutional Neural Network

A novel anomaly detection method for multimodal WSN data flow via a dynamic graph neural network

Intelligent fault diagnosis of rolling bearings based on normalized CNN considering data imbalance and variable working conditions