Abstract:Anomaly detection in videos is challenging due to the complexity, noise, and diverse nature of activities such as violence, shoplifting, and vandalism. While deep learning (DL) has shown excellent performance in this area, existing approaches have struggled to apply DL models across different anomaly tasks without extensive retraining. This repeated retraining is time-consuming, computationally intensive, and unfair. To address this limitation, a new DL framework is introduced in this study, consisting of three key components: transfer learning to enhance feature generalization, model fusion to improve feature representation, and multi-task classification to generalize the classifier across multiple tasks without training from scratch when new task is introduced. The framework's main advantage is its ability to generalize without requiring retraining from scratch for each new task. Empirical evaluations demonstrate the framework's effectiveness, achieving an accuracy of 97.99% on the RLVS dataset (violence detection), 83.59% on the UCF dataset (shoplifting detection), and 88.37% across both datasets using a single classifier without retraining. Additionally, when tested on an unseen dataset, the framework achieved an accuracy of 87.25%. The study also utilizes two explainability tools to identify potential biases, ensuring robustness and fairness. This research represents the first successful resolution of the generalization issue in anomaly detection, marking a significant advancement in the field.

Irregular Event Classification in Surveillance Videos Using an Auto-Encoder Deep Learning Framework

Abnormal Event Detection in Videos using Spatiotemporal AutoEncoder

Abnormal Event Detection In Videos Using Deep Embedding

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

A Deep Learning Approach to Video Anomaly Detection using Convolutional Autoencoders

Residual spatiotemporal autoencoder for unsupervised video anomaly detection

Unsupervised anomalous event detection in videos using spatio-temporal inter-fused autoencoder

An Efficient CNN and BI-LSTM Model for Abnormal Event Detection in Video Surveillance

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos

Object-centric and memory-guided network-based normality modeling for video anomaly detection

Attention-based residual autoencoder for video anomaly detection

Deep learning based anomaly detection in real-time video

Weakly-supervised Joint Anomaly Detection and Classification

Appearance-Motion united Auto-Encoder Framework for Video Anomaly Detection

Anomaly3D: Video Anomaly Detection Based on 3D-Normality Clusters

Collaborative Normality Learning Framework for Weakly Supervised Video Anomaly Detection

DSLSTM: a deep convolutional encoder–decoder architecture for abnormality detection in video surveillance

Visual anomaly detection in video by variational autoencoder

Abnormal Events Detection Using Deep Networks for Video Surveillance.

A Scalable and Generalized Deep Learning Framework for Anomaly Detection in Surveillance Videos