Abstract:Due to the fuzziness of anomaly definition and the complexity of scenes in real video data, video anomaly detection is still a challenging task. In this work, we explored a novel lightweight dual branch convolution neural architecture that can separate appearance-motion representations to capture spatial and temporal information, respectively, since abnormal events are usually different from normal cases in appearance or motion behavior. Considering the channel redundancy problem in the traditional neural network, and the feature information processed by different branches is different, the corresponding channel attenuation is carried out, which greatly improves the speed of anomaly detection while maintaining the performance of the model. In order to improve the utilization of key features, we exploited a Channel Squeeze and Excitation module and insert it into the encoder part of the network to focus on the channel correlation and adaptively recalibrate the characteristic response of the channel. The importance of each feature channel is automatically acquired through learning, and then according to the importance, the useful channels are promoted and the channels that are not useful for the current task are suppressed. In addition, in order to increase the reconstruction error of the motion encoder and consider the diversity of the normal patterns, we propose to use a memory module to augment the motion U-Net, where the items in the memory record the prototype mode of the normal data. The experiments on three benchmark datasets, UCSD Ped2, CHUK Avenue, and ShanghaiTech, demonstrate that our method achieves AUC scores of 96.3%, 87.4%, and 73.5%, respectively. The experimental speed reaches 55fps, showing a competitive performance relative to the current state of research.

Surveillance Video Anomaly Detection with Feature Enhancement and Consistency Frame Prediction

Anomaly Detection Based on Latent Feature Training in Surveillance Scenarios

Spatiotemporal consistency-enhanced network for video anomaly detection

Integrated Multiscale Appearance Features and Motion Information Prediction Network for Anomaly Detection

Video Anomaly Detection Via Successive Image Frame Prediction Leveraging Optical Flows

Anomaly Detection of Predicted Frames Based on U-Net Feature Vector Reconstruction

Robust Unsupervised Video Anomaly Detection by Multipath Frame Prediction

Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Prediction

Abnormal Event Detection in Surveillance Videos Based on Multi-Scale Feature and Channel-Wise Attention Mechanism

Anomaly Event Detection in Security Surveillance Using Two-Stream Based Model

Anomaly Warning: Learning and Memorizing Future Semantic Patterns for Unsupervised Ex-ante Potential Anomaly Prediction

Decoupled appearance and motion learning for efficient anomaly detection in surveillance video

Future Frame Prediction for Anomaly Detection -- A New Baseline

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Pedestrian Spatio-Temporal Information Fusion For Video Anomaly Detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Surveillance Video Anomaly Detection Via Non-Local U-Net Frame Prediction

Frame-Level Efficient Video Anomaly Detection Based on Prototype Networks

A Novel Unsupervised Video Anomaly Detection Framework Based on Optical Flow Reconstruction and Erased Frame Prediction

Channel based approach via faster dual prediction network for video anomaly detection

Appearance-Motion Memory Consistency Network for Video Anomaly Detection