Abstract:The purpose of this paper is to present an unsupervised video anomaly detection method using Optical Flow decomposition and Spatio-Temporal feature learning (OFST). This method employs a combination of optical flow reconstruction and video frame prediction to achieve satisfactory results. The proposed OFST framework is composed of two modules: the Multi-Granularity Memory-augmented Autoencoder with Optical Flow Decomposition (MG-MemAE-OFD) and a Two-Stream Network based on Spatio-Temporal feature learning (TSN-ST). The MG-MemAE-OFD module is composed of three functional blocks: optical flow decomposition, autoencoder, and multi-granularity memory networks. The optical flow decomposition block is used to extract the main motion information of objects in optical flow, and the granularity memory network is utilized to memorize normal patterns and improve the quality of the reconstructions. To predict video frames, we introduce a two-stream network based on spatiotemporal feature learning (TSN-ST), which adopts parallel standard Transformer blocks and a temporal block to learn spatiotemporal features from video frames and optical flows. The OFST combines these two modules so that the prediction error of abnormal samples is further increased due to the larger reconstruction error. In contrast, the normal samples obtain a lower reconstruction error and prediction error. Therefore, the anomaly detection capability of the method is greatly enhanced. Our proposed model was evaluated on public datasets. Specifically, in terms of the area under the curve (AUC), our model achieved an accuracy of 85.74% on the Ped1 dataset, 99.62% on the Ped2 dataset, 93.89% on the Avenue dataset, and 76.0% on the ShanghaiTech Dataset. Our experimental results show an average improvement of 1.2% compared to the current state-of-the-art.

Histograms of Optical Flow Orientation for Visual Abnormal Events Detection

Histograms of optical flow orientation for abnormal events detection

Detection of Abnormal Visual Events Via Global Optical Flow Orientation Histogram

Detection Of Abnormal Events Via Optical Flow Feature Analysis

Detection of Visual Abnormal Events via One-class SVM

Abnormal Behavior Detection Based on Regional Optical Flow

Histogram of Maximal Optical Flow Projection for Abnormal Events Detection in Crowded Scenes

Abnormal Event Detection Via Covariance Matrix for Optical Flow Based Feature.

Real-Time Detection of ATM Abnormal Events Based on Optical Flow

Online Detection of Abnormal Events in Video Streams

Violence detection based on histogram of optical flow orientation

Abnormal event detection via the analysis of multi-frame optical flow information

Fighting Detection Based on Optical Flow Context Histogram

Abnormal Event Detection Based on Analysis of Movement Information of Video Sequence

Video Anomaly Detection Based on Optical Flow Information

Fast Anomaly Detection in Traffic Surveillance Video Based on Robust Sparse Optical Flow

Anomaly Detection In Crowded Scenes By Sl-Hof Descriptor And Foreground Classification

Real-time Anomaly Detection with HMOF Feature

AN EFFICIENT ANOMALY DETECTION APPROACH IN SURVEILLANCE VIDEO BASED ON ORIENTED GMM

An unsupervised video anomaly detection method via Optical Flow decomposition and Spatio-Temporal feature learning

Abnormal Event Detection Method in Surveillance Video Based on Temporal CNN and Sparse Optical Flow