Abstract:Video anomaly detection is a promising yet challenging task, where only normal events are observed in the training phase. Without any explicit classification boundary between normal and abnormal events, anomaly detection can be turned into an outlier detection problem by regarding any event that does not conform to the normal patterns as an anomaly. Most of the existing works mainly focus on improving the representation of normal events, while ignore the relationship between normal and abnormal events. Besides, the lack of restrictions on classification boundaries also leads to performance degradation. To ad-dress the above problems, we design a novel autoencoder-based Memory-Augmented Appearance-Motion Network (MAAM-Net), which consists of a novel end-to-end network to learn appearance and motion fea-ture of a given input frame, a fused memory module to build a bridge for normal and abnormal events, a well-designed margin-based latent loss to relieve the computation costs, and a pointed Patch-based Stride Convolutional Detection (PSCD) algorithm to eliminate the degradation phenomenon. Specifically, the memory module is embedded between the encoder and decoder, which serves as a sparse dictionary of normal patterns, therefore it can be further employed to reintegrate abnormal events during inference. To further distort the reintegration quality of abnormal events, the margin-based latent loss is leveraged to enforce the memory module to select a sparse set of critical memory items. Last but not least, the simple yet effective detection method focuses on patches rather than the overall frame responses, which can benefit from the distortion of abnormal events. Extensive experiments and ablation studies on three anomaly detection benchmarks, i.e., UCSD Ped2, CUHK Avenue, and ShanghaiTech, demonstrate the ef-fectiveness and efficiency of our proposed MAAM-Net. Notably, we achieve superior AUC performances on UCSD Ped2 (0.977), CHUK Avenue (0.909), and ShanghaiTech (0.713). The code is publicly available at https://github.com/Owen- Tian/MAAM-Net .(c) 2023 Published by Elsevier Ltd.

Dual-branch Network with Memory for Video Anomaly Detection

Channel based approach via faster dual prediction network for video anomaly detection

Transformer Based Memory Network for Video Anomaly Detection

Attention-based residual autoencoder for video anomaly detection

Dual-Channel Autoencoder with Key Region Feature Enhancement for Video Anomalous Event Detection

A novel spatio-temporal memory network for video anomaly detection

Enhanced Memory Adversarial Network for Anomaly Detection

Learning dual updatable memory modules for video anomaly detection

Memory Enhanced Spatial-Temporal Graph Convolutional Autoencoder for Human-Related Video Anomaly Detection.

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Spatio-Temporal Unity Networking for Video Anomaly Detection

Self Attention Based Bi-directional Long Short-Term Memory Auto Encoder for Video Anomaly Detection

Memory-augmented Appearance-Motion Network for Video Anomaly Detection.

Multi Chunk Learning Based Auto Encoder for Video Anomaly Detection

Video Anomaly Detection Based on Global–Local Convolutional Autoencoder

Video Anomaly Detection Based on Convolutional Recurrent AutoEncoder

Video Anomaly Detection Using Dual Discriminator Based Generative Adversarial Network.

An informative dual ForkNet for video anomaly detection

Video Anomaly Detection Based on Attention Mechanism

Spatiotemporal Masked Autoencoder with Multi-Memory and Skip Connections for Video Anomaly Detection

Two‐stage video anomaly detection based on dual‐stream networks and multi‐instance learning