Abstract:Surveillance videos are able to capture a variety of realistic anomalies. In this paper, we propose to learn anomalies by exploiting both normal and anomalous videos. To avoid annotating the anomalous segments or clips in training videos, which is very time consuming, we propose to learn anomaly through the deep multiple instance ranking framework by leveraging weakly labeled training videos, i.e. the training labels (anomalous or normal) are at video-level instead of clip-level. In our approach, we consider normal and anomalous videos as bags and video segments as instances in multiple instance learning (MIL), and automatically learn a deep anomaly ranking model that predicts high anomaly scores for anomalous video segments. Furthermore, we introduce sparsity and temporal smoothness constraints in the ranking loss function to better localize anomaly during training. We also introduce a new large-scale first of its kind dataset of 128 hours of videos. It consists of 1900 long and untrimmed real-world surveillance videos, with 13 realistic anomalies such as fighting, road accident, burglary, robbery, etc. as well as normal activities. This dataset can be used for two tasks. First, general anomaly detection considering all anomalies in one group and all normal activities in another group. Second, for recognizing each of 13 anomalous activities. Our experimental results show that our MIL method for anomaly detection achieves significant improvement on anomaly detection performance as compared to the state-of-the-art approaches. We provide the results of several recent deep learning baselines on anomalous activity recognition. The low recognition performance of these baselines reveals that our dataset is very challenging and opens more opportunities for future work. The dataset is available at: <a class="link-external link-https" href="https://webpages.uncc.edu/cchen62/dataset.html" rel="external noopener nofollow">this https URL</a>

Person Anomaly Detection-Based Videos Surveillance System In Urban Integrated Pipe Gallery

Image Processing and Multi-Instance Learning-Based Recognition of Abnormal Behavior in Integrated Pipe Corridors

Deep learning based anomaly detection in real-time video

Human-Machine Cooperative Video Anomaly Detection

An Object-Aware Anomaly Detection and Localization in Surveillance Videos.

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Unveiling Anomaly : Empowering Video Surveillance through Intelligent Anomaly Detection

Improved Anomaly Detection in Surveillance Videos with Multiple Probabilistic Models Inference

Attention-based anomaly detection in multi-view surveillance videos

Video Anomaly Detection Based on Attention Mechanism

Anomaly3D: Video Anomaly Detection Based on 3D-Normality Clusters

Sequential Attention Mechanism for Weakly Supervised Video Anomaly Detection

Anomaly Detection in Video Sequences: A Benchmark and Computational Model

Anomaly detection in surveillance video using motion direction statistics

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Artificial Intelligence of Things-assisted two-stream neural network for anomaly detection in surveillance Big Video Data

Real-world Anomaly Detection in Surveillance Videos

Video Anomaly Detection Based on Deep Learning

Cognition Guided Video Anomaly Detection Framework for Surveillance Services

Multiscale Recovery Diffusion Model with Unsupervised Learning for Video Anomaly Detection System

Multi-scale Spatial-temporal Interaction Network for Video Anomaly Detection