Abstract:Video anomaly detection (VAD) is a vital task with great practical applications in industrial surveillance, security system, and traffic control. Unlike previous unsupervised VAD methods that adopt a fixed structure to learn normality without considering different detection demands, we design a spatial-temporal hierarchical architecture (STHA) as a configurable architecture to flexibly detect different degrees of anomaly. The comprehensive structure of the STHA is delineated into a tripartite hierarchy, encompassing the following tiers: the stream level, the stack level, and the block level. Specifically, we design several auto-encoder-based blocks that possess varying capacities for extracting normal patterns. Then, we stack blocks according to the complexity degrees with both intra-stack and inter-stack residual links to learn hierarchical normality gradually. Considering the multisource knowledge of videos, we also model the spatial normality of video frames and temporal normality of RGB difference by designing two parallel streams consisting of stacks. Thus, STHA can provide various representation learning abilities by expanding or contracting hierarchically to detect anomalies of different degrees. Since the anomaly set is complicated and unbounded, our STHA can adjust its detection ability to adapt to the human detection demands and the complexity degree of anomaly that happened in the history of a scene. We conduct experiments on three benchmarks and perform extensive analysis, and the results demonstrate that our method performs comparablely to the state-of-the-art methods. In addition, we design a toy dataset to prove that our model can better balance the learning ability to adapt to different detection demands.

Anomaly Detection Via Local Coordinate Factorization And Spatio-Temporal Pyramid

Anomaly Detection with ELM-Based Visual Attribute and Spatio-temporal Pyramid

Anomaly Detection Via Midlevel Visual Attributes

Anomaly Detection Method Based on Temporal Spatial Information Enhancement

Voila: Visual Anomaly Detection and Monitoring with Streaming Spatiotemporal Data

Transformer Based Sptial-Temporal Extraction Model for Video Anomaly Detection

Anomaly Detection Based on Spatio-Temporal Sparse Representation and Visual Attention Analysis.

Object-Oriented Anomaly Detection In Surveillance Videos

Anomaly Detection in Spatiotemporal Data Via Regularized Non-Negative Tensor Analysis

Learning to Detect Anomalies in Surveillance Video.

Anomaly Detection In Crowded Scenes By Sl-Hof Descriptor And Foreground Classification

Configurable Spatial-Temporal Hierarchical Analysis for Flexible Video Anomaly Detection

Multi-Scale Video Anomaly Detection by Multi-Grained Spatio-Temporal Representation Learning

Spatio-Temporal-based Context Fusion for Video Anomaly Detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Anomaly Detection Based on Latent Feature Training in Surveillance Scenarios

Video Anomaly Detection for Smart Surveillance

Video Anomaly Detection Based on a Hierarchical Activity Discovery Within Spatio-Temporal Contexts.

Video Anomaly Detection with Multi-Scale Feature and Temporal Information Fusion

Learning Spatio-Temporal Relations with Multi-Scale Integrated Perception for Video Anomaly Detection

Drastic Anomaly Detection In Video Using Motion Direction Statistics