Abstract:The purpose of this paper is to present an unsupervised video anomaly detection method using Optical Flow decomposition and Spatio-Temporal feature learning (OFST). This method employs a combination of optical flow reconstruction and video frame prediction to achieve satisfactory results. The proposed OFST framework is composed of two modules: the Multi-Granularity Memory-augmented Autoencoder with Optical Flow Decomposition (MG-MemAE-OFD) and a Two-Stream Network based on Spatio-Temporal feature learning (TSN-ST). The MG-MemAE-OFD module is composed of three functional blocks: optical flow decomposition, autoencoder, and multi-granularity memory networks. The optical flow decomposition block is used to extract the main motion information of objects in optical flow, and the granularity memory network is utilized to memorize normal patterns and improve the quality of the reconstructions. To predict video frames, we introduce a two-stream network based on spatiotemporal feature learning (TSN-ST), which adopts parallel standard Transformer blocks and a temporal block to learn spatiotemporal features from video frames and optical flows. The OFST combines these two modules so that the prediction error of abnormal samples is further increased due to the larger reconstruction error. In contrast, the normal samples obtain a lower reconstruction error and prediction error. Therefore, the anomaly detection capability of the method is greatly enhanced. Our proposed model was evaluated on public datasets. Specifically, in terms of the area under the curve (AUC), our model achieved an accuracy of 85.74% on the Ped1 dataset, 99.62% on the Ped2 dataset, 93.89% on the Avenue dataset, and 76.0% on the ShanghaiTech Dataset. Our experimental results show an average improvement of 1.2% compared to the current state-of-the-art.

Anomaly Detection Method Based on Temporal Spatial Information Enhancement

Anomaly Detection Based on Latent Feature Training in Surveillance Scenarios

Anomaly Detection Based on Spatio-Temporal Sparse Representation and Visual Attention Analysis.

Anomaly Detection in Traffic Scenes via Spatial-aware Motion Reconstruction

Spatio-Temporal Unity Networking for Video Anomaly Detection

Anomaly Detection Via Local Coordinate Factorization And Spatio-Temporal Pyramid

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Two-stream Deep Spatial-Temporal Auto-Encoder for Surveillance Video Abnormal Event Detection

An unsupervised video anomaly detection method via Optical Flow decomposition and Spatio-Temporal feature learning

Anomaly Residual Prediction with Spatial-Temporal and Perceptual Constraints

Integrated Multiscale Appearance Features and Motion Information Prediction Network for Anomaly Detection

Anomaly detection using sparse reconstruction in crowded scenes

Video Anomaly Detection Based on Cross-Frame Prediction Mechanism and Spatio-Temporal Memory-Enhanced Pseudo-3D Encoder.

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Robust Unsupervised Video Anomaly Detection by Multipath Frame Prediction

Abnormal Event Detection Method in Surveillance Video Based on Temporal CNN and Sparse Optical Flow

Transformer Based Sptial-Temporal Extraction Model for Video Anomaly Detection

Video Anomaly Detection with Multi-Scale Feature and Temporal Information Fusion

Video Anomaly Detection Via Successive Image Frame Prediction Leveraging Optical Flows

Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Abnormal event detection via the analysis of multi-frame optical flow information