Abstract:Representation of videos is essential since it conveys an understanding of video content and enables many higher level tasks to be tackled efficiently. However, it is challenging to propose a rational representation for complex event videos, as most video information is either noisy or redundant. In this paper, we propose a compact event representation method that can concisely describe the inner modes of events. We deem that an optimal event representation scheme should reflect the long-term and high-level visual semantics (visual topics) of events, so different from previous frame-level video semantics representation methods and concept-based video representation methods, we investigate the problem from the perspective of segment-level video representations. We then present three appealing properties of segment-level visual semantics. Based on the observation, we propose different algorithms that rely on a novel deep-visual-word-based video encoding method to discover latent discriminative patterns of events. Finally, our multi-mode event representation is obtained by concatenating the discovered patterns as inner modes. We adopt our event representation for representative event parts mining, which can highlight the visual topics of events and remarkably prune the raw videos. We validate our event representation method based on complex event detection task. Experimental results on two standard benchmarking datasets, MED11 and CCV Dataset, show that the proposed method can significantly outperform the state-of-the-art approaches.

Social event recognition method based on visual attributes

Enhancing Video Event Recognition Using Automatically Constructed Semantic-Visual Knowledge Base.

Complex Event Detection Via Multi-source Video Attributes.

Automatic Visual Concept Learning for Social Event Understanding

Pedestrian Attribute Recognition Via Spatio-temporal Relationship Learning for Visual Surveillance

Crowd Video Retrieval Via Deep Attribute-Embedding Graph Ranking

Socializing the Videos: A Multimodal Approach for Social Relation Recognition

Multi-scale Harmonic Mean Time Surfaces for Event-based Object Classification

Video Identification Using Spatio-temporal Salient Points

Event Detection In Basketball Video Using Multiple Modalities

Security Event Recognition for Visual Surveillance

Discovering Latent Discriminative Patterns for Multi-Mode Event Representation.

High-level Event Recognition in Unconstrained Videos

Multi-object Events Recognition from Video Sequences Using Extended Finite State Machine

Learning Predictable And Discriminative Attributes For Visual Recognition

Hierarchical Visual Event Pattern Mining and Its Applications

Attributes Co-occurrence Pattern Mining for Video-based Person Re-identification

MVGAN: Multi-View Graph Attention Network for Social Event Detection

Automatic Detection Algorithm of Football Events in Videos

Semantic event detection via multimodal data mining

Effective video event detection via subspace projection