Abstract:Video anomaly detection (VAD) has been paid increasing attention due to its potential applications, its current dominant tasks focus on online detecting anomalies% at the frame level, which can be roughly interpreted as the binary or multiple event classification. However, such a setup that builds relationships between complicated anomalous events and single labels, e.g., ``vandalism'', is superficial, since single labels are deficient to characterize anomalous events. In reality, users tend to search a specific video rather than a series of approximate videos. Therefore, retrieving anomalous events using detailed descriptions is practical and positive but few researches focus on this. In this context, we propose a novel task called Video Anomaly Retrieval (VAR), which aims to pragmatically retrieve relevant anomalous videos by cross-modalities, e.g., language descriptions and synchronous audios. Unlike the current video retrieval where videos are assumed to be temporally well-trimmed with short duration, VAR is devised to retrieve long untrimmed videos which may be partially relevant to the given query. To achieve this, we present two large-scale VAR benchmarks, UCFCrime-AR and XDViolence-AR, constructed on top of prevalent anomaly datasets. Meanwhile, we design a model called Anomaly-Led Alignment Network (ALAN) for VAR. In ALAN, we propose an anomaly-led sampling to focus on key segments in long untrimmed videos. Then, we introduce an efficient pretext task to enhance semantic associations between video-text fine-grained representations. Besides, we leverage two complementary alignments to further match cross-modal contents. Experimental results on two benchmarks reveal the challenges of VAR task and also demonstrate the advantages of our tailored method. Captions are publicly released at <a class="link-external link-https" href="https://github.com/Roc-Ng/VAR" rel="external noopener nofollow">this https URL</a>.

Video Abnormal Target Description Based on CRF Model

Adaptive Video Segmentation Algorithm Using Hidden Conditional Random Fields

Abnormal Detection based on Conditional Random Fields and Background Scene Partition

Scene description based on the conditional random fields model

A Novel Video Object Tracking Approach Based on Kernel Density Estimation and Markov Random Field

Abnormal Event Detection Based on Multi-scale Markov Random Field.

A Constrained Self-adaptive Sparse Combination Representation Method for Abnormal Event Detection.

Abnormal Behavior Detection Based on Target Analysis

A General Framework of Video Segmentation to Logical Unit Based on Conditional Random Fields

Cognition Guided Video Anomaly Detection Framework for Surveillance Services

Abnormal behavior analysis based on latent topic model

Abnormal behavior capture of video dynamic target based on 3D convolutional neural network

Abnormal behavior detection algorithm based on multi-branch convolutional fusion neural network

Video Abstraction Based on Fmri-Driven Visual Attention Model

Towards Video Anomaly Retrieval from Video Anomaly Detection: New Benchmarks and Model

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Conditional Random Fields for Multiview Sequential Data Modeling.

Real-world Video Anomaly Detection by Extracting Salient Features in Videos

3D ResNet with Ranking Loss Function for Abnormal Activity Detection in Videos

Efficient robust conditional random fields

An Abnormal Behavior Detection Method based on Feature Extraction