An anomaly-introduced learning method for abnormal event detection

HeChengkun,ShaoJie,SunJiayu

DOI: https://doi.org/10.5555/3288251.3288290

IF: 2.577

2018-01-01

Multimedia Tools and Applications

Abstract:Abnormal event detection aims at identifying anomalies under specific scene and it is widely utilized in health monitoring, public security and pedestrian surveillance. The main challenges are spat...

What problem does this paper attempt to address?

Anomaly Detection Algorithm Based on Electric Equipment

Yu Sun,Gangfeng Yan,Xiasheng Shi

DOI: https://doi.org/10.1088/1757-899x/631/4/042046

2019-01-01

IOP Conference Series Materials Science and Engineering

Abstract:Abstract Traditional methods for detecting data anomalies of power equipment fail to fully mine the data characteristics. And it has shortcomings such as complex calculation, poor flexibility and low accuracy. To solve the problem of abnormal fault detection of electric equipment, the abnormal detection algorithm based on statistical analysis and machine learning is used in the paper. The reconstruction method based on Long Short Term Memory (LSTM) time sequence is proposed for time series data abnormal detection. Experiments show that the new method is effective in detecting and correcting abnormal data, which reduces the detection time and improves the accuracy of state estimation results. There are huge differences within the positive samples in anomaly detection, so several methods are studied in the paper. One-class SVM algorithm is often used in novelty detection and isolation forest algorithm is used in outlier detection. Machine learning methods which is based on statistical analysis will play an increasingly important role in the fields of equipment monitoring and predictive maintenance, safety of electric equipment.
An Object-Aware Anomaly Detection and Localization in Surveillance Videos.

Xianghao Zang,Ge Li,Zhihao Li,Nannan Li,Wenmin Wang

DOI: https://doi.org/10.1109/bigmm.2016.33

2016-01-01

Abstract:Abnormal event detection plays an important role in video surveillance and smart camera systems. Existing methods in the literature are usually not object-aware, where different objects are not distinguished in processing. In this work, we propose an efficient object-aware anomaly detection scheme, specifically focusing on certain object categories, such as pedestrians. We first perform a block-based foreground segmentation to confine our analysis to moving objects and avoid irrelevant background dynamics. Then we discard uninterested objects by running an object detector on connected blocks. Finally we extract histograms of block-motion trajectories and cluster them to represent normal events. Our experiments demonstrate the accuracy and efficiency of the proposed method on dataset (PKU-SVD-B). We also propose a clip-based evaluation criterion with practical consideration and discuss this method at last.
Pose-oriented scene-adaptive matching for abnormal event detection

Yuxing Yang,Leiyu Xie,Zeyu Fu,Jiawei Yan,Syed Mohsen Naqvi

DOI: https://doi.org/10.1016/j.neucom.2024.128673

IF: 6

2024-10-06

Neurocomputing

Abstract:For intelligent surveillance systems, abnormal event detection automatically analyses surveillance video sequences and detects abnormal objects or unusual human actions at the frame level. Due to the lack of labelled data, most approaches are semi-supervised based on reconstruction or prediction methods. However, these methods may not generalize well to unseen scene contexts. To address this issue, we present a novel self and mutual scene-adaptive matching method for abnormal event detection. In the framework, we propose synergistic pose estimation and object detection, which effectively integrates human pose and object detection information to improve pose estimation accuracy. Then, the poses are resized to reduce the spatial distance between the source and target domains. The improved pose sequences are further fed into a spatio-temporal graph convolutional network to extract the geometric features. Finally, the features are embedded in a clustering layer to classify action types and compute normality scores. The training data is taken from the training part of common video anomaly detection datasets: UCSD PED1 & PED2, CHUK Avenue, and ShanghaiTech Campus. The proposed framework is evaluated on video sequences with unseen scene contexts in the UCSD PED2 and ShanghaiTech Campus datasets. The detection accuracy and efficiency are also evaluated in detail, and the proposed method for abnormal event detection achieves the highest AUC performance, 84.6%, on the ShanghaiTech Campus dataset and relatively high AUC performance, 96.9% and 74.8%, on UCSD PED2 & PED1 datasets. Compared with other state-of-the-art works, the performance analysis and results confirm the robustness and effectiveness of our proposed framework for cross-scene abnormal event detection.

computer science, artificial intelligence
AnomalyCD: A Benchmark for Earth Anomaly Change Detection with High-Resolution and Time-Series Observations

Jingtao Li,Qian Zhu,Xinyu Wang,Hengwei Zhao,Yanfei Zhong

2024-01-01

Abstract:Various Earth anomalies have destroyed the stable, balanced state, resulting in fatalities and serious destruction of property. With the advantages of large-scale and precise observation, high-resolution remote sensing images have been widely used for anomaly monitoring and localization. Powered by the deep representation, the existing methods have achieved remarkable advances, primarily in classification and change detection techniques. However, labeled samples are difficult to acquire due to the low probability of anomaly occurrence, and the trained models are limited to fixed anomaly categories, which hinders the application for anomalies with few samples or unknown anomalies. In this paper, to tackle this problem, we propose the anomaly change detection (AnomalyCD) technique, which accepts time-series observations and learns to identify anomalous changes by learning from the historical normal change pattern. Compared to the existing techniques, AnomalyCD processes an unfixed number of time steps and can localize the various anomalies in a unified manner, without human supervision. To benchmark AnomalyCD, we constructed a high-resolution dataset with time-series images dedicated to various Earth anomalies (the AnomalyCDD dataset). AnomalyCDD contains high-resolution (from 0.15 to 2.39 m/pixel), time-series (from 3 to 7 time steps), and large-scale images (1927.93 km2 in total) collected globally Furthermore, we developed a zero-shot baseline model (AnomalyCDM), which implements the AnomalyCD technique by extracting a general representation from the segment anything model (SAM) and conducting temporal comparison to distinguish the anomalous changes from normal changes. AnomalyCDM is designed as a two-stage workflow to enhance the efficiency, and has the ability to process the unseen images directly, without retraining for each scene.
Learn Suspected Anomalies from Event Prompts for Video Anomaly Detection

Chenchen Tao,Xiaohao Peng,Chong Wang,Jiafei Wu,Puning Zhao,Jun Wang,Jiangbo Qian

2024-09-03

Abstract:Most models for weakly supervised video anomaly detection (WS-VAD) rely on multiple instance learning, aiming to distinguish normal and abnormal snippets without specifying the type of anomaly. However, the ambiguous nature of anomaly definitions across contexts may introduce inaccuracy in discriminating abnormal and normal events. To show the model what is anomalous, a novel framework is proposed to guide the learning of suspected anomalies from event prompts. Given a textual prompt dictionary of potential anomaly events and the captions generated from anomaly videos, the semantic anomaly similarity between them could be calculated to identify the suspected events for each video snippet. It enables a new multi-prompt learning process to constrain the visual-semantic features across all videos, as well as provides a new way to label pseudo anomalies for self-training. To demonstrate its effectiveness, comprehensive experiments and detailed ablation studies are conducted on four datasets, namely XD-Violence, UCF-Crime, TAD, and ShanghaiTech. Our proposed model outperforms most state-of-the-art methods in terms of AP or AUC (86.5\%, \hl{90.4}\%, 94.4\%, and 97.4\%). Furthermore, it shows promising performance in open-set and cross-dataset cases. The data, code, and models can be found at: \url{<a class="link-external link-https" href="https://github.com/shiwoaz/lap" rel="external noopener nofollow">this https URL</a>}.

Computer Vision and Pattern Recognition
Research of Anomaly detection based on Dynamic Anomaly Detection Enhancement Framework

Xiaoxun Zhu,Songwei Weng,Yu Wang,Xiaoxia Gao,Zhen Yang,Jingyuan Cao,Lijiang Dong,Xiang Lin

DOI: https://doi.org/10.1088/1361-6501/ad889b

IF: 2.398

2024-10-20

Measurement Science and Technology

Abstract:Anomaly detection plays a crucial role in various fields, from industrial defect inspection to geological detection. However, traditional approaches often struggle with insufficient discriminability and an inability to generalize to unseen anomalies. These limitations stem from the practical difficulty in gathering a comprehensive set of anomalies and the tendency to overlook anomalous instances in favor of normal samples. To address these challenges, we propose a novel Dynamic Anomaly Detection Enhancement Framework, integrating three key innovations: (1) SaliencyAug: An adaptive saliency-guided augmentation method that generates realistic pseudo-samples to enhance learning of rare anomalies, improving model generalization. (2) DynAB: A dynamic attention block that achieves effective multi-level feature fusion while minimizing redundant information, enhancing detection accuracy. (3) DualOM: A dual-head optimization module which employs separate heads for normal and anomalous sample learning, creating more explicit and discriminative decision boundaries. Extensive experiments across multiple real-world datasets demonstrate our framework's superior performance in detecting a wide range of anomalies, demonstrating 2.4% improvement over state-of-the-art methods.

engineering, multidisciplinary,instruments & instrumentation
Anomaly Detection and Localization in Crowded Scenes by Motion-field Shape Description and Similarity-based Statistical Learning

Xinfeng Zhang,Su Yang,Xinjian Zhang,Weishan Zhang,Jiulong Zhang

DOI: https://doi.org/10.48550/arXiv.1805.10620

2018-05-27

Abstract:In crowded scenes, detection and localization of abnormal behaviors is challenging in that high-density people make object segmentation and tracking extremely difficult. We associate the optical flows of multiple frames to capture short-term trajectories and introduce the histogram-based shape descriptor referred to as shape contexts to describe such short-term trajectories. Furthermore, we propose a K-NN similarity-based statistical model to detect anomalies over time and space, which is an unsupervised one-class learning algorithm requiring no clustering nor any prior assumption. Firstly, we retrieve the K-NN samples from the training set in regard to the testing sample, and then use the similarities between every pair of the K-NN samples to construct a Gaussian model. Finally, the probabilities of the similarities from the testing sample to the K-NN samples under the Gaussian model are calculated in the form of a joint probability. Abnormal events can be detected by judging whether the joint probability is below predefined thresholds in terms of time and space, separately. Such a scheme can adapt to the whole scene, since the probability computed as such is not affected by motion distortions arising from perspective distortion. We conduct experiments on real-world surveillance videos, and the results demonstrate that the proposed method can reliably detect and locate the abnormal events in the video sequences, outperforming the state-of-the-art approaches.

Computer Vision and Pattern Recognition
Event-driven Weakly Supervised Video Anomaly Detection

Shengyang Sun,Xiaojin Gong

DOI: https://doi.org/10.1016/j.imavis.2024.105169

IF: 3.86

2024-01-01

Image and Vision Computing

Abstract:Inspired by the observations of human working manners, this work proposes an event-driven method for weakly supervised video anomaly detection. Complementary to the conventional snippet-level anomaly detection, this work designs an event analysis module to predict the event-level anomaly scores as well. It first generates event proposals simply via a temporal sliding window and then constructs a cascaded causal transformer to capture temporal dependencies for potential events of varying durations. Moreover, a dual-memory augmented self-attention scheme is also designed to capture global semantic dependencies for event feature enhancement. The network is learned with a standard multiple instance learning (MIL) loss, together with normal-abnormal contrastive learning losses. During inference, the snippet- and event-level anomaly scores are fused for anomaly detection. Experiments show that the event-level analysis helps to detect anomalous events more continuously and precisely. The performance of the proposed method on three public datasets demonstrates that the proposed approach is competitive with state-of-the-art methods.
Learning to Detect Anomalies in Surveillance Video.

Tan Xiao,Chao Zhang,Hongbin Zha

DOI: https://doi.org/10.1109/lsp.2015.2410031

2015-01-01

IEEE Signal Processing Letters

Abstract:Detecting anomalies in surveillance videos, that is, finding events or objects with low probability of occurrence, is a practical and challenging research topic in computer vision community. In this paper, we put forward a novel unsupervised learning framework for anomaly detection. At feature level, we propose a Sparse Semi-nonnegative Matrix Factorization (SSMF) to learn local patterns at each pixel, and a Histogram of Nonnegative Coefficients (HNC) can be constructed as local feature which is more expressive than previously used features like Histogram of Oriented Gradients (HOG). At model level, we learn a probability model which takes the spatial and temporal contextual information into consideration. Our framework is totally unsupervised requiring no human-labeled training data. With more expressive features and more complicated model, our framework can accurately detect and localize anomalies in surveillance video. We carried out extensive experiments on several benchmark video datasets for anomaly detection, and the results demonstrate the superiority of our framework to state-of-the-art approaches, validating the effectiveness of our framework.
Video anomaly detection based on scene classification

Hongjun Li,Xulin Shen,Xiaohu Sun,Yunlong Wang,Chaobo Li,Junjie Chen

DOI: https://doi.org/10.1007/s11042-023-15328-7

IF: 2.577

2023-04-29

Multimedia Tools and Applications

Abstract:As a significant research hotspot in the field of computer vision, video anomaly detection plays an essential role in ensuring public safety. Anomaly detection remains a challenging task given the complex situation in public areas and the large random distribution of crowds. The density of people in the same scene varies greatly due to the instability of the pedestrian volume. Specifically, the characteristics of crowd distribution mainly include low density, small aggregation and dispersion, or large aggregation and severe occlusion. Considering the large difference between high-density and low-density crowd characteristics, we propose an anomaly detection algorithm based on scene classification in order to obtain better anomaly detection result. Firstly, we propose a novel scene classification method, which uses pre-trained YoloV4 model to detect the number of people in the video frames and generate heatmaps, and extracts pixel features through the Double-Canny algorithm to represent the occlusion degree of the crowd. Furthermore, K-Means clustering is used to adaptively divide the scene into sparse and dense. Secondly, the Generative Adversarial Network (GAN) based on prediction and reconstruction is introduced to detect anomalies respectively, and the final accuracy is achieved by combining the detection accuracy of both networks. Finally, experiments on three benchmark datasets demonstrate the competitive performance of our method with the state-of-the-art methods.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Weakly Supervised Anomaly Detection in Videos Considering the Openness of Events

Chen Zhang,Guorong Li,Qianqian Xu,Xinfeng Zhang,Li Su,Qingming Huang

DOI: https://doi.org/10.1109/tits.2022.3174088

IF: 8.5

2022-11-13

IEEE Transactions on Intelligent Transportation Systems

Abstract:Although various weakly supervised anomaly detection methods have been proposed in recent years, generalization of anomaly detection is still not well-explored. Existing weakly supervised methods usually use normal and abnormal events to pose anomaly detection as a regression problem. However, defining concepts that encompass all possible normal and abnormal event patterns is nearly unrealistic, so the anomaly detection model is likely to face both open normal and abnormal events in practical applications. We find some weakly supervised anomaly detection methods suffer from performance degradation when faced with open events due to their poor generalization. To tackle this issue, we propose a two-branch weakly supervised approach, which can improve the anomaly detection performance of open events without affecting the performance of the seen events. Specifically, considering that the pattern of open events is different from that of seen events, we design a Test Data Analyzer (TDA) that determines whether the test video features belong to seen or open data and argue for separate treatment for them. For the seen data, a classifier trained by multiple instance learning is used to predict anomaly scores. For the open data, we design an anomaly detection model via meta-learning named Meta-Learning Anomaly Detection (MLAD), which can directly determine whether open data is abnormal without updating model parameters. In detail, MLAD synthesizes pseudo-seen data and pseudo-open data so that the model can learn to detect anomalies in open data by transferring the knowledge of seen data. Experimental results validate the effectiveness of our proposed method.

engineering, electrical & electronic,transportation science & technology, civil
AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

Ziming Huang,Xurui Li,Haotian Liu,Feng Xue,Yuzhe Wang,Yu Zhou

2024-10-18

Abstract:In the industrial scenario, anomaly detection could locate but cannot classify anomalies. To complete their capability, we study to automatically discover and recognize visual classes of industrial anomalies. In terms of multi-class anomaly classification, previous methods cluster anomalies represented by frozen pre-trained models but often fail due to poor discrimination. Novel class discovery (NCD) has the potential to tackle this. However, it struggles with non-prominent and semantically weak anomalies that challenge network learning focus. To address these, we introduce AnomalyNCD, a multi-class anomaly classification framework compatible with existing anomaly detection methods. This framework learns anomaly-specific features and classifies anomalies in a self-supervised manner. Initially, a technique called Main Element Binarization (MEBin) is first designed, which segments primary anomaly regions into masks to alleviate the impact of incorrect detections on learning. Subsequently, we employ mask-guided contrastive representation learning to improve feature discrimination, which focuses network attention on isolated anomalous regions and reduces the confusion of erroneous inputs through re-corrected pseudo labels. Finally, to enable flexible classification at both region and image levels during inference, we develop a region merging strategy that determines the overall image category based on the classified anomaly regions. Our method outperforms the state-of-the-art works on the MVTec AD and MTD datasets. Compared with the current methods, AnomalyNCD combined with zero-shot anomaly detection method achieves a 10.8% $F_1$ gain, 8.8% NMI gain, and 9.5% ARI gain on MVTec AD, 12.8% $F_1$ gain, 5.7% NMI gain, and 10.8% ARI gain on MTD. The source code is available at <a class="link-external link-https" href="https://github.com/HUST-SLOW/AnomalyNCD" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Positive unlabeled learning‐based anomaly detection in videos

Huiyu Mu,Ruizhi Sun,Gang Yuan,Guoqing Shi

DOI: https://doi.org/10.1002/int.22437

IF: 8.993

2021-05-02

International Journal of Intelligent Systems

Abstract:<p>Anomaly detection plays a critical role in intelligent video surveillance. However, real‐world video data obtained always contains large numbers of normal video data, along with large numbers of unlabeled data. A promising solution with one‐class classification and semi‐supervised learning may not be satisfactory as they fail to make good use of unlabeled data with only normal data available. In this paper, we introduced a new framework, called Positive Unlabeled learning‐based Anomaly event Detection (PU‐AD), to exploit the weakly‐supervised information. To the best of our knowledge, this is the first work that introduces the PU idea and achieves detecting abnormal events with a limited number of partially labeled data. Experiments on real‐world surveillance videos show that the proposed method outperforms the existing state‐of‐the‐art methods.</p>

computer science, artificial intelligence
A Sequential Monte Carlo Approach To Anomaly Detection In Tracking Visual Events

Peng Cui,Lifeng Sun,Zhi-qiang Liu,Shiqiang Yang

DOI: https://doi.org/10.1109/CVPR.2007.383515

2007-01-01

Abstract:In this paper we propose a technique to detect anomalies in individual and interactive event sequences. We categorize anomalies into two classes: abnormal event, and abnormal context, and model them in the Sequential Monte Carlo framework which is extended by Markov Random Field for tracking interactive events. Firstly, we propose a novel pixel-wise event representation method to construct feature images, in which each blob corresponds to a visual event. Then we transform the original blob-level features into subspaces to model probabilistic appearance manifolds for each event-class. With the probability of an observation associated with each event-class (or state) derived from probabilistic manifolds, and state transitional probability, the prior and posterior state distributions can be estimated. We demonstrate in experiments that the approach can reliably detect such anomalies with low false alarm rates.
AED-Net: An Abnormal Event Detection Network

Tian Wang,Zichen Miao,Yuxin Chen,Yi Zhou,Guangcun Shan,Hichem Snoussi

DOI: https://doi.org/10.48550/arXiv.1903.11891

2019-03-28

Abstract:It is challenging to detect the anomaly in crowded scenes for quite a long time. In this paper, a self-supervised framework, abnormal event detection network (AED-Net), which is composed of PCAnet and kernel principal component analysis (kPCA), is proposed to address this problem. Using surveillance video sequences of different scenes as raw data, PCAnet is trained to extract high-level semantics of crowd's situation. Next, kPCA,a one-class classifier, is trained to determine anomaly of the scene. In contrast to some prevailing deep learning methods,the framework is completely self-supervised because it utilizes only video sequences in a normal situation. Experiments of global and local abnormal event detection are carried out on UMN and UCSD datasets, and competitive results with higher EER and AUC compared to other state-of-the-art methods are observed. Furthermore, by adding local response normalization (LRN) layer, we propose an improvement to original AED-Net. And it is proved to perform better by promoting the framework's generalization capacity according to the experiments.

Computer Vision and Pattern Recognition
Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Yang Liu,Shuang Li,Jing Liu,Hao Yang,Mengyang Zhao,Xinhua Zeng,Wei Ni,Liang Song

DOI: https://doi.org/10.1109/ishc54333.2021.00034

2021-01-01

Abstract:Video anomaly detection is an essential and challenging task in the computer vision community, which aims to automatically detect and localize abnormal events in videos. In this paper, we propose an attention augmented spatial-temporal normality learning framework to explore the unique spatial and temporal patterns of normal events. Specifically, we first slice the videos into local spatial-temporal cubes along the spatial and temporal dimensions to facilitate independent learning of the prototypical spatial and temporal patterns of normal videos. In the training phase, we use parallel deep convolutional neural networks to learn the spatial features of each cube and introduce an attention module to guide the model to focus on the important local cubes. Then, to exploit the complementary information of adjacent video fragments in the temporal dimension, we use a convolutional long-short memory network to model temporal patterns. In the testing phase, we calculate the prediction errors of the salient areas and compute the anomaly score by measuring the difference between the testing samples and the learned spatial-temporal normality. Experimental results on standard benchmarks show that the proposed method achieves a comparable performance to the state-of-the-art methods with frame-level AUCs of 96.6%, 85.2%, and 68.8% on UCSD Ped2, CUHK Avenue, and ShanghaiTech, respectively.
Influence-aware Attention Networks for Anomaly Detection in Surveillance Videos

Sijia Zhang,Maoguo Gong,Yu Xie,A. K. Qin,Hao Li,Yuan Gao,Yew-Soon Ong

DOI: https://doi.org/10.1109/tcsvt.2022.3148392

IF: 5.859

2022-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Detecting anomalies in videos is a fundamental issue in public security. The majority of existing deep learning methods often perform anomaly detection based on the behavior or the trajectory of a single target. However, due to the overlaps of the crowd and the low-resolution of monitoring images, the segmentation of population is hard to implement and the features cannot be learned thoroughly, which make the methods be easily disturbed by visual elements and thus may lead to false detection sometimes. To tackle these problems, we propose the influence-aware attention to learn the representative attributes of the whole crowd. Walking pedestrians can be divided into numbers of flows, and in this paper, we aim to measure the consistency of movement patterns in the same stream and the interactions between different streams. Meanwhile, great importance is given to the relation between pedestrians and the circumstance for certain anomalies occur as a result of environmental issues. Specifically, the influence-aware attention module is composed of the motion attention and the location attention, which is designed to quantify the relations in the scene from spatial and temporal aspects. For the lack of abnormal samples, we utilize a dual generator-based framework to learn interactions among normal scenes. Experimental results on six benchmarks verify the effectiveness and robustness of our proposed method.

engineering, electrical & electronic
Interactive System-wise Anomaly Detection

Guanchu Wang,Ninghao Liu,Daochen Zha,Xia Hu

2023-04-21

Abstract:Anomaly detection, where data instances are discovered containing feature patterns different from the majority, plays a fundamental role in various applications. However, it is challenging for existing methods to handle the scenarios where the instances are systems whose characteristics are not readily observed as data. Appropriate interactions are needed to interact with the systems and identify those with abnormal responses. Detecting system-wise anomalies is a challenging task due to several reasons including: how to formally define the system-wise anomaly detection problem; how to find the effective activation signal for interacting with systems to progressively collect the data and learn the detector; how to guarantee stable training in such a non-stationary scenario with real-time interactions? To address the challenges, we propose InterSAD (Interactive System-wise Anomaly Detection). Specifically, first, we adopt Markov decision process to model the interactive systems, and define anomalous systems as anomalous transition and anomalous reward systems. Then, we develop an end-to-end approach which includes an encoder-decoder module that learns system embeddings, and a policy network to generate effective activation for separating embeddings of normal and anomaly systems. Finally, we design a training method to stabilize the learning process, which includes a replay buffer to store historical interaction data and allow them to be re-sampled. Experiments on two benchmark environments, including identifying the anomalous robotic systems and detecting user data poisoning in recommendation models, demonstrate the superiority of InterSAD compared with state-of-the-art baselines methods.

Machine Learning,Artificial Intelligence
Anomaly Event Detection in Security Surveillance Using Two-Stream Based Model

Wangli Hao,Ruixian Zhang,Shancang Li,Junyu Li,Fuzhong Li,Shanshan Zhao,Wuping Zhang

DOI: https://doi.org/10.1155/2020/8876056

IF: 1.968

2020-08-03

Security and Communication Networks

Abstract:Anomaly event detection has been extensively researched in computer vision in recent years. Most conventional anomaly event detection methods can only leverage the single-modal cues and not deal with the complementary information underlying other modalities in videos. To address this issue, in this work, we propose a novel two-stream convolutional networks model for anomaly detection in surveillance videos. Specifically, the proposed model consists of RGB and Flow two-stream networks, in which the final anomaly event detection score is the fusion of those of two networks. Furthermore, we consider two fusion situations, including the fusion of two streams with the same or different number of layers respectively. The design insight is to leverage the information underlying each stream and the complementary cues of RGB and Flow two-stream sufficiently. Two datasets (UCF-Crime and ShanghaiTech) are used to validate the effectiveness of proposed solution.

computer science, information systems,telecommunications
Video Anomaly Detection Based on Attention Mechanism

Qianqian Zhang,Hongyang Wei,Jiaying Chen,Xusheng Du,Jiong Yu

DOI: https://doi.org/10.3390/sym15020528

2023-02-17

Symmetry

Abstract:Camera surveillance is widely used in residential areas, highways, schools and other public places. The monitoring and scanning of sudden abnormal events depend on humans. Human anomaly monitoring not only consumes a lot of manpower and time but also has a large error in anomaly detection. Video anomaly detection based on AE (Auto-Encoder) is currently the dominant research approach. The model has a highly symmetrical network structure in the encoding and decoding stages. The model is trained by learning standard video sequences, and the anomalous events are later determined in terms of reconstruction error and prediction error. However, in the case of limited computing power, the complex model will greatly reduce the detection efficiency, and unnecessary background information will seriously affect the detection accuracy of the model. This paper uses the AE loaded with dynamic prototype units as the basic model. We introduce an attention mechanism to improve the feature representation ability of the model. Deep separable convolution operation can effectively reduce the number of model parameters and complexity. Finally, we conducted experiments on three publicly available datasets of real scenarios (UCSD Ped1, UCSD Ped2 and CUHK Avenue). The experimental results show that compared with the baseline model, the accuracy of our model improved by 1.9%, 1.4% and 6.6%, respectively, across the three datasets. Compared with many popular models, the validity of our model in anomaly detection is verified.

multidisciplinary sciences

An anomaly-introduced learning method for abnormal event detection

Anomaly Detection Algorithm Based on Electric Equipment

An Object-Aware Anomaly Detection and Localization in Surveillance Videos.

Pose-oriented scene-adaptive matching for abnormal event detection

AnomalyCD: A Benchmark for Earth Anomaly Change Detection with High-Resolution and Time-Series Observations

Learn Suspected Anomalies from Event Prompts for Video Anomaly Detection

Research of Anomaly detection based on Dynamic Anomaly Detection Enhancement Framework

Anomaly Detection and Localization in Crowded Scenes by Motion-field Shape Description and Similarity-based Statistical Learning

Event-driven Weakly Supervised Video Anomaly Detection

Learning to Detect Anomalies in Surveillance Video.

Video anomaly detection based on scene classification

Weakly Supervised Anomaly Detection in Videos Considering the Openness of Events

AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

Positive unlabeled learning‐based anomaly detection in videos

A Sequential Monte Carlo Approach To Anomaly Detection In Tracking Visual Events

AED-Net: An Abnormal Event Detection Network

Learning Attention Augmented Spatial-temporal Normality for Video Anomaly Detection

Influence-aware Attention Networks for Anomaly Detection in Surveillance Videos

Interactive System-wise Anomaly Detection

Anomaly Event Detection in Security Surveillance Using Two-Stream Based Model

Video Anomaly Detection Based on Attention Mechanism