Abstract:This research has been investigating an automatic and online crowd anomaly detection model by exploring a novel compound image descriptor generated from live video streams. A dual-channel convolutional neural network (DCCNN) has been set up for efficiently processing scene-related and motion-related crowd information inherited from raw frames and the compound descriptor instances. The novelty of the work stemmed from the creation of the spatio-temporal cuboids in online (or near real-time) manner through dynamically extracting local feature tracklets within the temporal space while handling the foreground region-of-interests (i.e., moving targets) through the exploration of Gaussian Mixture Model in the spatial space. Hence, the extracted foreground blocks can effectively eliminate irrelevant backgrounds and noises from the live streams for reducing the computational costs in the subsequent detecting phases. The devised compound feature descriptor, named as spatio-temporal feature descriptor (STFD), is capable of characterizing the crowd attributes through the measures such as collectiveness, stability, conflict and density in each online generated spatio-temporal cuboid. A STFD instance registers not only the dynamic variation of the targeted crowd over time based on local feature tracklets, but also the interaction information of neighborhoods within a crowd, e.g., the interaction force through the K-nearest neighbor (K-NN) analysis. The DCCNN developed in this research enables online identification of suspicious crowd behaviors based on analyzing the live-feed images and their STFD instances. The proposed model has been developed and evaluated against benchmarking techniques and databases. Experimental results have shown substantial improvements in terms of detection accuracy and efficiency for online crowd abnormal behavior identification.

Contrasting Estimation of Pattern Prototypes for Anomaly Detection in Urban Crowd Flow

Trading off Coverage and Emergency for Hybrid Task Scheduling in Traffic Anomaly Detection

Anomaly Candidate Identification and Starting Time Estimation of Vehicles from Traffic Videos.

Anomaly Detection and Localization in Crowded Scenes Using Short-Term Trajectories

Anomaly Detection for Videos of Crowded Scenes Based on Optical Flow Information

A Decomposition Approach for Urban Anomaly Detection Across Spatiotemporal Data

Detecting Urban Anomalies Using Multiple Spatio-Temporal Data Sources

Anomaly Detection and Localisation in the Crowd Scenes Using a Block-Based Social Force Model

Unusual event detection in crowded scenes by trajectory analysis

Spatial-temporal Convolutional Neural Networks for Anomaly Detection and Localization in Crowded Scenes

Unsupervised fast anomaly detection in crowds.

Abnormal Event Detection and Location for Dense Crowds using Repulsive Forces and Sparse Reconstruction

Anomalous Behaviors Detection in Moving Crowds Based on a Weighted Convolutional Autoencoder-Long Short-Term Memory Network

Real-time Anomaly Detection in Crowd Scenes Using CP-GMM Model

Multi-Dimensional Optical Flow Embedded Genetic Programming for Anomaly Detection in Crowded Scenes.

Pattern and Anomaly Detection in Urban Temporal Networks

Anomaly Detection through Spatio-temporal Context Modeling in Crowded Scenes

Abnormal Events Detection in Crowded Scenes by Trajectory Cluster

Anomaly Detection and Localization in Crowded Scenes by Motion-field Shape Description and Similarity-based Statistical Learning

Dual-channel CNN for efficient abnormal behavior identification through crowd feature engineering

Automatic clustering method of abnormal crowd flow pattern detection