Abstract:This research has been investigating an automatic and online crowd anomaly detection model by exploring a novel compound image descriptor generated from live video streams. A dual-channel convolutional neural network (DCCNN) has been set up for efficiently processing scene-related and motion-related crowd information inherited from raw frames and the compound descriptor instances. The novelty of the work stemmed from the creation of the spatio-temporal cuboids in online (or near real-time) manner through dynamically extracting local feature tracklets within the temporal space while handling the foreground region-of-interests (i.e., moving targets) through the exploration of Gaussian Mixture Model in the spatial space. Hence, the extracted foreground blocks can effectively eliminate irrelevant backgrounds and noises from the live streams for reducing the computational costs in the subsequent detecting phases. The devised compound feature descriptor, named as spatio-temporal feature descriptor (STFD), is capable of characterizing the crowd attributes through the measures such as collectiveness, stability, conflict and density in each online generated spatio-temporal cuboid. A STFD instance registers not only the dynamic variation of the targeted crowd over time based on local feature tracklets, but also the interaction information of neighborhoods within a crowd, e.g., the interaction force through the K-nearest neighbor (K-NN) analysis. The DCCNN developed in this research enables online identification of suspicious crowd behaviors based on analyzing the live-feed images and their STFD instances. The proposed model has been developed and evaluated against benchmarking techniques and databases. Experimental results have shown substantial improvements in terms of detection accuracy and efficiency for online crowd abnormal behavior identification.

Abnormal Activity Recognition Based on Deep Learning in Crowd

ABNORMAL CROWD BEHAVIOUR DETECTION BASED ON DEEP LEARNING AND SPARSE REPRESENTATION

Deep Representation for Abnormal Event Detection in Crowded Scenes

Abnormal event detection in crowded scenes based on deep learning

Crowd Abnormal Behavior Detection Combining Movement and Emotion Descriptors

Using Deep Learning Models Combined with Crowd Emotion Models to Identify Abnormal Behaviors in Crowds

Human Action Recognition From Digital Videos Based on Deep Learning.

An Abnormal Behavior Detection Method of Video Crowds and Vehicles Based on Deep Learning

Abnormal Human Activity Recognition using Bayes Classifier and Convolutional Neural Network

Inter-Frame Differences and Convolution Neural Network Based Abnormal Crowd Event Recognition.

Abnormal behavior detection algorithm based on multi-branch convolutional fusion neural network

Crowd Abnormal Detection Using Two-Stream Fully Convolutional Neural Networks

Research on Human Abnormal Behavior Detection Based on Deep Learning

Dual-channel CNN for efficient abnormal behavior identification through crowd feature engineering

Abnormal behavior recognition using 3D-CNN combined with LSTM

An Abnormal Behavior Recognition Method Based on Fusion Features

An End-to-End Human Abnormal Behavior Recognition Framework for Crowds With Mentally Disordered Individuals

Learning Deep Event Models for Crowd Anomaly Detection

Abnormal Behavior Recognition Based on 3D Dense Connections

Plug-and-Play CNN for Crowd Motion Analysis: An Application in Abnormal Event Detection

An Efficient CNN and BI-LSTM Model for Abnormal Event Detection in Video Surveillance