Abstract:The recognition of abnormal behavior in surveillance video is the focus of current research, which has high research value and broad application possibilities. Its main applications are in the fields of intelligent surveillance, intelligent security, and smart cities, and it is of great significance to study the recognition of abnormal behaviors. Because of the complexity of human movement and the variability of the external environment, the recognition and detection of abnormal behaviors have some challenges. The recognition and detection of abnormal human behaviors in surveillance video still needs further research and development. This paper uses the multi-branch convolutional neural network to extract the spatial features of video frames for the first time, and as an encoder to pass the condensed features to the Gated Recurrent Unit (GRU), which extracts Temporal features from multiple video frames. And then the Gated Recurrent Unit output the result as the decoder. We did a series of comparative experiments on UCF-Crime dataset. And finally, we achieved an accuracy of 86.78% in the test set. The experimental results show that our multi-branch convolutional fusion neural network is better than previous surveillance video abnormal behavior recognition algorithms. At the same time, in order to verify the generalization performance and efficiency of the algorithm, we also conducted an experimental validation on the UCF-101 dataset in this paper, and the results show that the algorithm in this paper can also show a high accuracy rate on the UCF-101 dataset, and the speed of the algorithm is almost close to that of the C3D method with improved accuracy rate, making it possible to develop simple recognition applications based on the algorithm studied in this paper subsequently.

Detecting Abnormal Behaviors in Surveillance Videos Based on Fuzzy Clustering and Multiple Auto-Encoders

Memory Clustering Autoencoder Method for Human Action Anomaly Detection on Surveillance Camera Video

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

Appearance-Motion united Auto-Encoder Framework for Video Anomaly Detection

Video Anomaly Detection Based on Global–Local Convolutional Autoencoder

Spatiotemporal Masked Autoencoder with Multi-Memory and Skip Connections for Video Anomaly Detection

Synthetic Pseudo Anomalies for Unsupervised Video Anomaly Detection: A Simple yet Efficient Framework based on Masked Autoencoder

Self-Distilled Masked Auto-Encoders are Efficient Video Anomaly Detectors

Abnormal behavior detection algorithm based on multi-branch convolutional fusion neural network

An Efficient and Robust Unsupervised Anomaly Detection Method Using Ensemble Random Projection in Surveillance Videos

Abnormal Detection in Nuclear Security Videos Based on Label-specific Autoencoders and Reconstruction Errors Comparison

Configurable Spatial-Temporal Hierarchical Analysis for Flexible Video Anomaly Detection

Video Anomaly Detection Based on Spatio-Temporal Relationships among Objects

Video Anomaly Detection Based on Attention Mechanism

A Novel Unsupervised Video Anomaly Detection Framework Based on Optical Flow Reconstruction and Erased Frame Prediction

Residual spatiotemporal autoencoder for unsupervised video anomaly detection

Object-centric and memory-guided network-based normality modeling for video anomaly detection

Pedestrian Spatio-Temporal Information Fusion For Video Anomaly Detection

A Model for Detecting Abnormal Elevator Passenger Behavior Based on Video Classification

An explainable and efficient deep learning framework for video anomaly detection

Collaborative Normality Learning Framework for Weakly Supervised Video Anomaly Detection