Abstract:Surveillance videos are able to capture a variety of realistic anomalies. In this paper, we propose to learn anomalies by exploiting both normal and anomalous videos. To avoid annotating the anomalous segments or clips in training videos, which is very time consuming, we propose to learn anomaly through the deep multiple instance ranking framework by leveraging weakly labeled training videos, i.e. the training labels (anomalous or normal) are at video-level instead of clip-level. In our approach, we consider normal and anomalous videos as bags and video segments as instances in multiple instance learning (MIL), and automatically learn a deep anomaly ranking model that predicts high anomaly scores for anomalous video segments. Furthermore, we introduce sparsity and temporal smoothness constraints in the ranking loss function to better localize anomaly during training. We also introduce a new large-scale first of its kind dataset of 128 hours of videos. It consists of 1900 long and untrimmed real-world surveillance videos, with 13 realistic anomalies such as fighting, road accident, burglary, robbery, etc. as well as normal activities. This dataset can be used for two tasks. First, general anomaly detection considering all anomalies in one group and all normal activities in another group. Second, for recognizing each of 13 anomalous activities. Our experimental results show that our MIL method for anomaly detection achieves significant improvement on anomaly detection performance as compared to the state-of-the-art approaches. We provide the results of several recent deep learning baselines on anomalous activity recognition. The low recognition performance of these baselines reveals that our dataset is very challenging and opens more opportunities for future work. The dataset is available at: <a class="link-external link-https" href="https://webpages.uncc.edu/cchen62/dataset.html" rel="external noopener nofollow">this https URL</a>

Model Selection of Anomaly Detectors in the Absence of Labeled Validation Data

Segmenting Remote Sensing Anomalies at Instance-level Via Anomaly Map Guided Adaptation

Towards Unsupervised Validation of Anomaly-Detection Models

Learn Suspected Anomalies from Event Prompts for Video Anomaly Detection

Unsupervised Model Selection for Time-series Anomaly Detection

Natural Synthetic Anomalies for Self-Supervised Anomaly Detection and Localization

Weakly Supervised Anomaly Detection: A Survey

Enhancing Anomaly Detection via Generating Diversified and Hard-to-distinguish Synthetic Anomalies

A Lightweight Video Anomaly Detection Model with Weak Supervision and Adaptive Instance Selection

Self-Attention Memory-Augmented Wavelet-CNN for Anomaly Detection

Segment Any Anomaly without Training via Hybrid Prompt Regularization

Application of Improved Asynchronous Advantage Actor Critic Reinforcement Learning Model on Anomaly Detection

Anomaly-Aware Semantic Segmentation by Leveraging Synthetic-Unknown Data

Adjacent Image Augmentation and Its Framework for Self-Supervised Learning in Anomaly Detection

RealNet: A Feature Selection Network with Realistic Synthetic Anomaly for Anomaly Detection

DSV: An Alignment Validation Loss for Self-supervised Outlier Model Selection

Self-supervision Meets Adversarial Perturbation: A Novel Framework for Anomaly Detection

Weakly Supervised Anomaly Detection via Knowledge-Data Alignment

AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection

Incorporating Physical Priors into Weakly-Supervised Anomaly Detection

Real-world Anomaly Detection in Surveillance Videos