Abstract:Crowd behavior analysis has recently attracted extensive attention in research. However, the existing research mainly focuses on investigating motion patterns in crowds, while the emotional aspects of crowd behaviors are left unexplored. Analyzing the emotion of crowd behaviors is indeed extremely important, as it uncovers the social moods that are beneficial for video surveillance. In this paper, we propose a novel crowd representation termed crowd mood. Crowd mood is established based upon the discovery that the social emotional hypothesis of crowd behaviors can be revealed by investigating the spacing interactions and the structural levels of motion patterns in crowds. To this end, we first learn the structured trajectories of crowds by particle advection using low-rank approximation with group sparsity constraint, which implicitly characterizes the coherent motion patterns. Second, rich emotional motion features are explicitly extracted and fused by support vector regression to reflect social characteristics. In particular, we construct weighted features in a boosted manner by considering the features’ significance. Finally, crowd mood is intuitively presented as affective curves to track the emotion states of the crowd dynamics, which is robust to noise, sensitive to semantic shift, and compact for pattern expressions. Extensive evaluations on crowd video data sets demonstrate that our approach effectively models crowd mood and achieves significantly better results with comparisons to several alternative and state-of-the-art approaches for various tasks, i.e., crowd mood classification, global abnormal mood detection, and crowd emotion matching.

Finding Coherent Motions and Semantic Regions in Crowd Scenes: A Diffusion and Clustering Approach.

A diffusion and clustering-based approach for finding coherent motions and understanding crowd scenes

Fine-Grained Urban Event Detection and Characterization Based on Tensor Cofactorization

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

Crowd Motion Monitoring with Thermodynamics-Inspired Feature

The Large-Scale Crowd Behavior Perception Based on Spatio-Temporal Viscous Fluid Field

Exploring Coherent Motion Patterns Via Structured Trajectory Learning for Crowd Mood Modeling

Crowd Behavior Analysis Via Curl and Divergence of Motion Trajectories

Optical Flow Dataset and Benchmark for Visual Crowd Analysis

A Thermodynamics-Inspired Feature for Anomaly Detection on Crowd Motions in Surveillance Videos

Toward Accurate Person-level Action Recognition in Videos of Crowed Scenes

Mobility Viewer: an Eulerian Approach for Studying Urban Crowd Flow

Motion Objects Segmentation Using a New Level Set Based Method

Crowd Scene Understanding with Coherent Recurrent Neural Networks.

Crowd Event Perception Based on Spatio-temporal Viscous Fluid Field

Wavelet-based Texture Model for Crowd Dynamic Analysis

Fusing Motion Patterns and Key Visual Information for Semantic Event Recognition in Basketball Videos

Fast Detection of Independent Motion in Crowds Guided by Supervised Learning

Crowd Saliency Detection via Global Similarity Structure

A Dynamic-Attention On Crowd Region With Physical Optical Flow Features For Crowd Counting

Learning Semantic Scene Models by Object Classification and Trajectory Clustering