Abstract:Deep learning-based video anomaly detection methods have drawn significant attention in the past few years due to their superior performance. However, almost all the leading methods for video anomaly detection rely on large-scale training datasets with long training times. As a result, many real-world video analysis tasks are still not applicable for fast deployment. On the other hand, the leading methods cannot provide interpretability due to the uninterpretable feature representations hiding the decision-making process when anomaly detection models are considered as a black box. However, the interpretability for anomaly detection is crucial since the corresponding response to the anomalies in the video is determined by their severity and nature. To tackle these problems, this paper proposes an efficient deep learning framework for video anomaly detection and provides explanations. The proposed framework uses pre-trained deep models to extract high-level concept and context features for training denoising autoencoder (DAE), requiring little training time (i.e., within 10 s on UCSD Pedestrian datasets) while achieving comparable detection performance to the leading methods. Furthermore, this framework presents the first video anomaly detection use of combing autoencoder and SHapley Additive exPlanations (SHAP) for model interpretability. The framework can explain each anomaly detection result in surveillance videos. In the experiments, we evaluate the proposed framework's effectiveness and efficiency while also explaining anomalies behind the autoencoder’s prediction. On the USCD Pedestrian datasets, the DAE achieved 85.9% AUC with a training time of 5 s on the USCD Ped1 and 92.4% AUC with a training time of 2.9 s on the UCSD Ped2.

Video Anomaly Detection Based on Deep Learning

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Video Anomaly Detection Based on Attention Mechanism

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

An explainable and efficient deep learning framework for video anomaly detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Deep Video Anomaly Detection: Opportunities and Challenges

Synthetic Pseudo Anomalies for Unsupervised Video Anomaly Detection: A Simple yet Efficient Framework based on Masked Autoencoder

Attention-based residual autoencoder for video anomaly detection

Anomaly3D: Video Anomaly Detection Based on 3D-Normality Clusters

Video Anomaly Detection Based on Global–Local Convolutional Autoencoder

Deep learning based anomaly detection in real-time video

Generate anomalies from normal: a partial pseudo-anomaly augmented approach for video anomaly detection

A Survey on Deep Learning Techniques for Video Anomaly Detection

Attention-Driven Loss for Anomaly Detection in Video Surveillance

Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Video Anomaly Detection using Pre-Trained Deep Convolutional Neural Nets and Context Mining

Learning Appearance-motion Normality for Video Anomaly Detection.

Real-world Video Anomaly Detection by Extracting Salient Features in Videos

A Deep Learning Approach to Video Anomaly Detection using Convolutional Autoencoders

Memory Enhanced Spatial-Temporal Graph Convolutional Autoencoder for Human-Related Video Anomaly Detection.