Abstract:Smart surveillance is a difficult task that is gaining popularity due to its direct link to human safety. Today, many indoor and outdoor surveillance systems are in use at public places and smart cities. Because these systems are expensive to deploy, these are out of reach for the vast majority of the public and private sectors. Due to the lack of a precise definition of an anomaly, automated surveillance is a challenging task, especially when large amounts of data, such as 24/7 CCTV footage, must be processed. When implementing such systems in real-time environments, the high computational resource requirements for automated surveillance becomes a major bottleneck. Another challenge is to recognize anomalies accurately as achieving high accuracy while reducing computational cost is more challenging. To address these challenge, this research is based on the developing a system that is both efficient and cost effective. Although 3D convolutional neural networks have proven to be accurate, they are prohibitively expensive for practical use, particularly in real-time surveillance. In this article, we present two contributions: a resource-efficient framework for anomaly recognition problems and two-class and multi-class anomaly recognition on spatially augmented surveillance videos. This research aims to address the problem of computation overhead while maintaining recognition accuracy. The proposed Temporal based Anomaly Recognizer (TAR) framework combines a partial shift strategy with a 2D convolutional architecture-based model, namely MobileNetV2. Extensive experiments were carried out to evaluate the model's performance on the UCF Crime dataset, with MobileNetV2 as the baseline architecture; it achieved an accuracy of 88% which is 2.47% increased performance than available state-of-the-art. The proposed framework achieves 52.7% accuracy for multiclass anomaly recognition on the UCF Crime2Local dataset. The proposed model has been tested in real-time camera stream settings and can handle six streams simultaneously without the need for additional resources.

Real-Time Anomaly Detection in Video Streams

Hybrid Architecture for Real-Time Video Anomaly Detection: Integrating Spatial and Temporal Analysis

Real time anomalies detection on video

Deep learning based anomaly detection in real-time video

Real-world Video Anomaly Detection by Extracting Salient Features in Videos

Voila: Visual Anomaly Detection and Monitoring with Streaming Spatiotemporal Data

Online Anomaly Detection over Live Social Video Streaming

Anomaly Detection Based on Latent Feature Training in Surveillance Scenarios

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Decoupled appearance and motion learning for efficient anomaly detection in surveillance video

Object-Oriented Anomaly Detection In Surveillance Videos

Artificial Intelligence of Things-assisted two-stream neural network for anomaly detection in surveillance Big Video Data

Real-time anomaly detection on surveillance video with two-stream spatio-temporal generative model

Anomalies cannot materialize or vanish out of thin air: A hierarchical multiple instance learning with position-scale awareness for video anomaly detection

Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach

Video Anomaly Detection using Pre-Trained Deep Convolutional Neural Nets and Context Mining

A Novel Unsupervised Video Anomaly Detection Framework Based on Optical Flow Reconstruction and Erased Frame Prediction

Efficient anomaly recognition using surveillance videos

Unveiling Anomaly : Empowering Video Surveillance through Intelligent Anomaly Detection

A comprehensive analysis of real-time video anomaly detection methods for human and vehicular movement