Abstract:Video anomaly detection is a promising yet challenging task, where only normal events are observed in the training phase. Without any explicit classification boundary between normal and abnormal events, anomaly detection can be turned into an outlier detection problem by regarding any event that does not conform to the normal patterns as an anomaly. Most of the existing works mainly focus on improving the representation of normal events, while ignore the relationship between normal and abnormal events. Besides, the lack of restrictions on classification boundaries also leads to performance degradation. To ad-dress the above problems, we design a novel autoencoder-based Memory-Augmented Appearance-Motion Network (MAAM-Net), which consists of a novel end-to-end network to learn appearance and motion fea-ture of a given input frame, a fused memory module to build a bridge for normal and abnormal events, a well-designed margin-based latent loss to relieve the computation costs, and a pointed Patch-based Stride Convolutional Detection (PSCD) algorithm to eliminate the degradation phenomenon. Specifically, the memory module is embedded between the encoder and decoder, which serves as a sparse dictionary of normal patterns, therefore it can be further employed to reintegrate abnormal events during inference. To further distort the reintegration quality of abnormal events, the margin-based latent loss is leveraged to enforce the memory module to select a sparse set of critical memory items. Last but not least, the simple yet effective detection method focuses on patches rather than the overall frame responses, which can benefit from the distortion of abnormal events. Extensive experiments and ablation studies on three anomaly detection benchmarks, i.e., UCSD Ped2, CUHK Avenue, and ShanghaiTech, demonstrate the ef-fectiveness and efficiency of our proposed MAAM-Net. Notably, we achieve superior AUC performances on UCSD Ped2 (0.977), CHUK Avenue (0.909), and ShanghaiTech (0.713). The code is publicly available at https://github.com/Owen- Tian/MAAM-Net .(c) 2023 Published by Elsevier Ltd.

Object-Guided and Motion-Refined Attention Network for Video Anomaly Detection

Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Attention-Driven Loss for Anomaly Detection in Video Surveillance

Memory-augmented Appearance-Motion Network for Video Anomaly Detection.

Video Anomaly Detection Based on Attention Mechanism

Appearance-Motion Memory Consistency Network for Video Anomaly Detection

Contrastive Attention for Video Anomaly Detection

Attention-based anomaly detection in multi-view surveillance videos

Object-based video anomaly detection using multi-attention and adaptive velocity attribute representation learning

Cross-Modal Attention Mechanism for Weakly Supervised Video Anomaly Detection.

Enhanced Memory Adversarial Network for Anomaly Detection

Influence-aware Attention Networks for Anomaly Detection in Surveillance Videos

AONet: Attention network with optional activation for unsupervised video anomaly detection

Video Anomaly Detection and Localization Based on an Adaptive Intra-Frame Classification Network

Channel based approach via faster dual prediction network for video anomaly detection

Robust Unsupervised Video Anomaly Detection by Multipath Frame Prediction

Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Prediction

Motion-aware Future Frame Prediction for Video Anomaly Detection Based on Saliency Perception

Cognition Guided Video Anomaly Detection Framework for Surveillance Services