Abstract:Human-related video anomaly detection is a challenging problem due to unclear definitions of anomalies and insufficient training data. Pose-based methods have attracted widespread attention by exploiting highly structured skeleton data that are robust to background noise and illumination changes. However, existing methods use recurrent neural network to extract temporal information while ignoring the spatial dependencies between skeleton joints, which are crucial to reason behaviors. Additionally, commonly-used methods are expected to produce larger reconstruction errors for anomalies than normal samples to achieve anomaly detection. But in practice, due to the strong generalization ability of these models, they fail to obtain significant reconstruction errors for abnormal samples, resulting in missing anomalies. In this paper, we propose a novel framework Memory Enhanced Spatial-Temporal Graph Convolutional Autoencoder(Mem-STGCAE) to address these problems. We use spatial-temporal graph convolution as an encoder to capture discriminative features in spatial and temporal domains. We enhance the autoencoder with a memory module that records normal patterns. The encoded representation is used as a query to retrieve the most relevant patterns. Thus, the decoder reconstructs anomalies using normal patterns, resulting in significant reconstruction errors. Different from traditional autoencoders, two branches of decoder are introduced to reconstruct past and predict future pose sequences respectively. Extensive experiments on two challenging video anomaly datasets, ShanghaiTech and IITB-Corridor, show that our proposed network outperforms other state-of-the-art methods.

Asymmetric Anomaly Detection for Human-Robot Interaction

Auto-AD: Autonomous Hyperspectral Anomaly Detection Network Based on Fully Convolutional Autoencoder

Anomalous State Recognition of Lane-changing Behavior Using a Hybrid Autoencoder Architecture

Anomaly Detection Based on a 3D Convolutional Neural Network Combining Convolutional Block Attention Module Using Merged Frames

Human-Machine Cooperative Video Anomaly Detection

Video Anomaly Detection Based on Attention Mechanism

Video Anomaly Detection Based on Convolutional Recurrent AutoEncoder

Abnormal Events Detection Method for Surveillance Video Using an Improved Autoencoder with Multi-Modal Input

Anomaly3D: Video Anomaly Detection Based on 3D-Normality Clusters

Memory Enhanced Spatial-Temporal Graph Convolutional Autoencoder for Human-Related Video Anomaly Detection.

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Dynamic Local Aggregation Network with Adaptive Clusterer for Anomaly Detection

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

3D U-Net for Video Anomaly Detection.

Deep learning based anomaly detection in real-time video

Anomaly Recognition from surveillance videos using 3D Convolutional Neural Networks

Attention-based residual autoencoder for video anomaly detection

TSAN: A New Deep Learning-Based Detection Method for Sensor Anomaly in Mobile Robots

Inverse-Transform AutoEncoder for Anomaly Detection

Abnormal Behavior Detection of ATM Surveillance Videos Based on Pseudo-3D Residual Network

EasyNet: An Easy Network for 3D Industrial Anomaly Detection