Abstract:Summary TRECVID Multimedia Event Detection offers an interesting but very challenging task in detecting high- level complex events (Figure 1) in user-generated videos. In this paper, we will present an overview and comparative analysis of our results, which achieved top performance among all 45 submissions in TRECVID 2010. Our aim is to answer the following questions. What kind of feature is more effective for multimedia event detection? Are features from different feature modalities (e.g., audio and visual) complementary for event detection? Can we benefit from generic concept detection of background scenes, human actions, and audio concepts? Are sequence matching and event-specific object detectors critical? Our findings indicate that spatial-temporal feature is very effective for event detection, and it's also very complementary to other features such as static SIFT and audio features. As a result, our baseline run combining these three features already achieves very impressive results, with a mean minimal normalized cost (MNC) of 0.586. Incorporating the generic concept detectors using a graph diffusion algorithm provides marginal gains (mean MNC 0.579). Sequence matching with Earth Mover's Distance (EMD) further improves the results (mean MNC 0.565). The event-specific detector (batter), however, didn't prove useful from our current re-ranking tests. We conclude that it is important to combine strong complementary features from multiple modalities for multimedia event detection, and cross-frame matching is helpful in coping with temporal order variation. Leveraging contextual concept detectors and foreground activities remains a very attractive direction requiring further research.

Video Event Detection using ICA Mixture Hidden Markov Models

An ICA Mixture Hidden Markov Model for Video Content Analysis

ICA Mixture Hidden Conditional Random Field Model for Sports Event Classification

EM-Based Mixture Models Applied to Video Event Detection

Hidden Markov Model Framework Using Independent Component Analysis Mixture Model

Modality Mixture Projections for Semantic Video Event Detection

RICA-MD: A Refined ICA Algorithm for Motion Detection

Ice Hockey Shooting Event Modeling with Mixture Hidden Markov Model

Soccer Video Event Detection By Fusing Middle Level Visual Semantics Of An Event Clip

Spatial-based Bayesian Hidden Markov Models with Dirichlet Mixtures for Video Anomaly Detection

Motion Based Event Recognition Using HMM

Efficient video object segmentation based on Gaussian mixture model and Markov random field

An HMM-based framework for video semantic analysis

Columbia-UCF TRECVID2010 Multimedia Event Detection: Combining Multiple Modalities, Contextual Concepts, and Temporal Matching.

Video Shot Boundary Detection Using Independent Component Analysis

Detecting video events based on action recognition in complex scenes using spatio-temporal descriptor.

AN HMM BASED ANALYSIS FRAMEWORK FOR SEMANTIC VIDEO EVENTS

Hidden Markov Model Based Events Detection In Soccer Video

Hierarchical Latent Concept Discovery for Video Event Detection

Motion detection based on independent component analysis