Abstract:Smart surveillance is a difficult task that is gaining popularity due to its direct link to human safety. Today, many indoor and outdoor surveillance systems are in use at public places and smart cities. Because these systems are expensive to deploy, these are out of reach for the vast majority of the public and private sectors. Due to the lack of a precise definition of an anomaly, automated surveillance is a challenging task, especially when large amounts of data, such as 24/7 CCTV footage, must be processed. When implementing such systems in real-time environments, the high computational resource requirements for automated surveillance becomes a major bottleneck. Another challenge is to recognize anomalies accurately as achieving high accuracy while reducing computational cost is more challenging. To address these challenge, this research is based on the developing a system that is both efficient and cost effective. Although 3D convolutional neural networks have proven to be accurate, they are prohibitively expensive for practical use, particularly in real-time surveillance. In this article, we present two contributions: a resource-efficient framework for anomaly recognition problems and two-class and multi-class anomaly recognition on spatially augmented surveillance videos. This research aims to address the problem of computation overhead while maintaining recognition accuracy. The proposed Temporal based Anomaly Recognizer (TAR) framework combines a partial shift strategy with a 2D convolutional architecture-based model, namely MobileNetV2. Extensive experiments were carried out to evaluate the model's performance on the UCF Crime dataset, with MobileNetV2 as the baseline architecture; it achieved an accuracy of 88% which is 2.47% increased performance than available state-of-the-art. The proposed framework achieves 52.7% accuracy for multiclass anomaly recognition on the UCF Crime2Local dataset. The proposed model has been tested in real-time camera stream settings and can handle six streams simultaneously without the need for additional resources.

CNN features with bi-directional LSTM for real-time anomaly detection in surveillance networks

An Efficient Anomaly Recognition Framework Using an Attention Residual LSTM in Surveillance Videos.

Intelligent Dual Stream CNN and Echo State Network for Anomaly Detection

Sequential Attention Mechanism for Weakly Supervised Video Anomaly Detection

Artificial Intelligence of Things-assisted two-stream neural network for anomaly detection in surveillance Big Video Data

EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos

AnomalyNet: a spatiotemporal motion-aware CNN approach for detecting anomalies in real-world autonomous surveillance

Detecting anomalies in security cameras with 3D-convolutional neural network and convolutional long short-term memory

A CNN-RNN Combined Structure for Real-World Violence Detection in Surveillance Cameras

Efficient anomaly recognition using surveillance videos

An Efficient CNN and BI-LSTM Model for Abnormal Event Detection in Video Surveillance

Anomaly Recognition from surveillance videos using 3D Convolutional Neural Networks

Deep learning based anomaly detection in real-time video

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

A Scalable and Generalized Deep Learning Framework for Anomaly Detection in Surveillance Videos

Anomaly detection in surveillance video based on bidirectional prediction

Integrated Multiscale Appearance Features and Motion Information Prediction Network for Anomaly Detection

Efficient Activity Recognition Using Lightweight CNN and DS-GRU Network for Surveillance Applications

Channel based approach via faster dual prediction network for video anomaly detection

Weakly-Supervised Anomaly Detection in Surveillance Videos Based on Two-Stream I3D Convolution Network

Anomaly Detection Based on a 3D Convolutional Neural Network Combining Convolutional Block Attention Module Using Merged Frames