Abstract:Due to the fuzziness of anomaly definition and the complexity of scenes in real video data, video anomaly detection is still a challenging task. In this work, we explored a novel lightweight dual branch convolution neural architecture that can separate appearance-motion representations to capture spatial and temporal information, respectively, since abnormal events are usually different from normal cases in appearance or motion behavior. Considering the channel redundancy problem in the traditional neural network, and the feature information processed by different branches is different, the corresponding channel attenuation is carried out, which greatly improves the speed of anomaly detection while maintaining the performance of the model. In order to improve the utilization of key features, we exploited a Channel Squeeze and Excitation module and insert it into the encoder part of the network to focus on the channel correlation and adaptively recalibrate the characteristic response of the channel. The importance of each feature channel is automatically acquired through learning, and then according to the importance, the useful channels are promoted and the channels that are not useful for the current task are suppressed. In addition, in order to increase the reconstruction error of the motion encoder and consider the diversity of the normal patterns, we propose to use a memory module to augment the motion U-Net, where the items in the memory record the prototype mode of the normal data. The experiments on three benchmark datasets, UCSD Ped2, CHUK Avenue, and ShanghaiTech, demonstrate that our method achieves AUC scores of 96.3%, 87.4%, and 73.5%, respectively. The experimental speed reaches 55fps, showing a competitive performance relative to the current state of research.

Motion detection via a couple of auto-encoder networks

Dynamic Background Learning Through Deep Auto-Encoder Networks

Auto-AD: Autonomous Hyperspectral Anomaly Detection Network Based on Fully Convolutional Autoencoder

New Method Of Background Update For Video-Based Vehicle Detection

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

Incorporating Deep Background Prior into Model-Based Method for Unsupervised Moving Vehicle Detection in Satellite Videos

Adaptive Background Model Based on Hybrid Structure Neural Network

Autoencoder-based background reconstruction and foreground segmentation with background noise estimation

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Background subtraction for video sequence using deep neural network

Background Prior-Based Salient Object Detection Via Deep Reconstruction Residual.

A General Moving Detection Method Using Dual-Target Nonparametric Background Model.

Decoupled appearance and motion learning for efficient anomaly detection in surveillance video

Improving Variational Autoencoder based Out-of-Distribution Detection for Embedded Real-time Applications

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

Road User Abnormal Trajectory Detection using a Deep Autoencoder

Channel based approach via faster dual prediction network for video anomaly detection

Place-specific Background Modeling Using Recursive Autoencoders

Deep Networks for Image Motion Estimation

Appearance-Motion united Auto-Encoder Framework for Video Anomaly Detection

Image Deblurring Based on a U-shaped Network for Vehicle Surveillance Scenarios