Abstract:Video anomaly detection is a promising yet challenging task, where only normal events are observed in the training phase. Without any explicit classification boundary between normal and abnormal events, anomaly detection can be turned into an outlier detection problem by regarding any event that does not conform to the normal patterns as an anomaly. Most of the existing works mainly focus on improving the representation of normal events, while ignore the relationship between normal and abnormal events. Besides, the lack of restrictions on classification boundaries also leads to performance degradation. To ad-dress the above problems, we design a novel autoencoder-based Memory-Augmented Appearance-Motion Network (MAAM-Net), which consists of a novel end-to-end network to learn appearance and motion fea-ture of a given input frame, a fused memory module to build a bridge for normal and abnormal events, a well-designed margin-based latent loss to relieve the computation costs, and a pointed Patch-based Stride Convolutional Detection (PSCD) algorithm to eliminate the degradation phenomenon. Specifically, the memory module is embedded between the encoder and decoder, which serves as a sparse dictionary of normal patterns, therefore it can be further employed to reintegrate abnormal events during inference. To further distort the reintegration quality of abnormal events, the margin-based latent loss is leveraged to enforce the memory module to select a sparse set of critical memory items. Last but not least, the simple yet effective detection method focuses on patches rather than the overall frame responses, which can benefit from the distortion of abnormal events. Extensive experiments and ablation studies on three anomaly detection benchmarks, i.e., UCSD Ped2, CUHK Avenue, and ShanghaiTech, demonstrate the ef-fectiveness and efficiency of our proposed MAAM-Net. Notably, we achieve superior AUC performances on UCSD Ped2 (0.977), CHUK Avenue (0.909), and ShanghaiTech (0.713). The code is publicly available at https://github.com/Owen- Tian/MAAM-Net .(c) 2023 Published by Elsevier Ltd.

Memory Augmented Generative Adversarial Networks for Anomaly Detection

A Cognitive Memory-Augmented Network for Visual Anomaly Detection

Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection

Adversarially Learned Anomaly Detection

Enhanced Memory Adversarial Network for Anomaly Detection

MDGAN: Boosting Anomaly Detection Using \\Multi-Discriminator Generative Adversarial Networks

Re Learning Memory Guided Normality for Anomaly Detection

on the effectiveness of generative adversarial network on anomaly detection

ADGAN: A Scalable GAN-based Architecture for Image Anomaly Detection

Learning dual updatable memory modules for video anomaly detection

Memory-augmented Appearance-Motion Network for Video Anomaly Detection.

Human-related Anomalous Event Detection Via Memory-Augmented Wasserstein Generative Adversarial Network with Gradient Penalty.

Memory-augmented Adversarial Autoencoders for Multivariate Time-series Anomaly Detection with Deep Reconstruction and Prediction

Regularized Cycle Consistent Generative Adversarial Network for Anomaly Detection

Anomaly Detection by Leveraging Incomplete Anomalous Knowledge with Anomaly-Aware Bidirectional GANs

Dual-encoder Bidirectional Generative Adversarial Networks for Anomaly Detection

Discriminative-Generative Dual Memory Video Anomaly Detection

Detecting Anomalies using Generative Adversarial Networks on Images

Anomaly Detection by Latent Regularized Dual Adversarial Networks.

GANomaly: Semi-supervised Anomaly Detection via Adversarial Training

Anomaly Detection with Memory-augmented Adversarial Autoencoder Networks for Industry 5.0