Abstract:Video anomaly detection is a promising yet challenging task, where only normal events are observed in the training phase. Without any explicit classification boundary between normal and abnormal events, anomaly detection can be turned into an outlier detection problem by regarding any event that does not conform to the normal patterns as an anomaly. Most of the existing works mainly focus on improving the representation of normal events, while ignore the relationship between normal and abnormal events. Besides, the lack of restrictions on classification boundaries also leads to performance degradation. To ad-dress the above problems, we design a novel autoencoder-based Memory-Augmented Appearance-Motion Network (MAAM-Net), which consists of a novel end-to-end network to learn appearance and motion fea-ture of a given input frame, a fused memory module to build a bridge for normal and abnormal events, a well-designed margin-based latent loss to relieve the computation costs, and a pointed Patch-based Stride Convolutional Detection (PSCD) algorithm to eliminate the degradation phenomenon. Specifically, the memory module is embedded between the encoder and decoder, which serves as a sparse dictionary of normal patterns, therefore it can be further employed to reintegrate abnormal events during inference. To further distort the reintegration quality of abnormal events, the margin-based latent loss is leveraged to enforce the memory module to select a sparse set of critical memory items. Last but not least, the simple yet effective detection method focuses on patches rather than the overall frame responses, which can benefit from the distortion of abnormal events. Extensive experiments and ablation studies on three anomaly detection benchmarks, i.e., UCSD Ped2, CUHK Avenue, and ShanghaiTech, demonstrate the ef-fectiveness and efficiency of our proposed MAAM-Net. Notably, we achieve superior AUC performances on UCSD Ped2 (0.977), CHUK Avenue (0.909), and ShanghaiTech (0.713). The code is publicly available at https://github.com/Owen- Tian/MAAM-Net .(c) 2023 Published by Elsevier Ltd.

Pose-Motion Video Anomaly Detection via Memory-Augmented Reconstruction and Conditional Variational Prediction

Video Anomaly Detection Using Diverse Motion-Conditioned Adversarial Predictive Network

Dual Conditioned Motion Diffusion for Pose-Based Video Anomaly Detection

Anomaly Detection with Prototype-Guided Discriminative Latent Embeddings

Enhanced Memory Adversarial Network for Anomaly Detection

Learning Appearance-Motion Synergy Via Memory-Guided Event Prediction for Video Anomaly Detection

Learning Appearance-motion Normality for Video Anomaly Detection.

A Hybrid Video Anomaly Detection Framework Via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Prediction

Memory Enhanced Spatial-Temporal Graph Convolutional Autoencoder for Human-Related Video Anomaly Detection.

Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

Video Anomaly Detection Based on Cross-Frame Prediction Mechanism and Spatio-Temporal Memory-Enhanced Pseudo-3D Encoder.

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Video Anomaly Detection Via Successive Image Frame Prediction Leveraging Optical Flows

Memory-augmented Appearance-Motion Network for Video Anomaly Detection.

A Novel Unsupervised Video Anomaly Detection Framework Based on Optical Flow Reconstruction and Erased Frame Prediction

A Dynamic Convolutional Generative Adversarial Network for Video Anomaly Detection

Memory-Augmented Spatial-Temporal Consistency Network for Video Anomaly Detection.

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Research on Video Anomaly Detection Based on Cascaded Memory-augmented Autoencoder

Long Short-Term Dynamic Prototype Alignment Learning for Video Anomaly Detection