Abstract:This paper proposed a systematical framework to address the essential problem, the semantic gap between extractable lowlevel features and meaningful high-level semantics, in content-based retrieval. Low-level features, which can be directly extracted from video streams, are color histogram, inter-frame differences, edges, etc. Theoretically, it is possible to detect events from these features based on hidden Markov models (HMMs) or dynamical Bayesian networks (DBNs), but, in practice, the models are too complicate to be built and to be trained. This paper proposed to employ cues as a middle stone to bridge the gap between the low-level features and the highlevel events. Cues have two salient characteristics: they hold causality with the events, and they can be deduced from features or extracted from video streams. Based on this idea, a systematical framework is constructed to analysis soccer videos, which is selected as a test bed for the fact that events (i.e. shoot event, foul event, and normal process) can be clearly defined in soccer game. First of all, the input video stream is segmented to shots based on the features directly extracted from videos; secondly, se-mantic cues, such as slow motion replay, face of player, caption, goalmouth, shot frequency, etc., are deduced or extracted from the shots; thirdly, three HMMs are built and trained to infer the three events from cues. In general video streams contain more than one event, thus an unavoidable problem is shots should be group to sets, in which there is only one event, for HMM-based events inference. In other words, shots should be appropriately grouped into sets of shots, so that the input observation sequences (a set of shots) fed into HMMs fit at least one of the models. Due to this self-enwound control structure, a hierarchical HMM (HHMM) is employed to group shots and to recognize events simultaneously in video stream. The experiments show the system is effective and robust in inferring events from roughly deduced or extracted cues.

Bayesian Network Based Soccer Video Event Detection and Retrieval

Creating Personalized Video Summaries Via Semantic Event Detection

Hidden Markov Model Based Events Detection In Soccer Video

Cues extraction and hierarchical HMM based events inference in soccer video

Multi-Mode Semantic Cues Based on Hidden Conditional Random Field in Soccer Video

Event Detection In Basketball Video Using Multiple Modalities

Event Analysis in Soccer Video by Dynamic Programming Based Fusion of Multiple Modalities

Recognizing Scoring in Basketball Game from AER Sequence by Spiking Neural Networks.

An Automatic Multi-Camera-based Event Extraction System for Real Soccer Videos.

Soccer Event Detection Using Deep Learning

Prediction of Shooting Events in Soccer Videos Using Complete Bipartite Graphs and Players' Spatial-Temporal Relations

Automatic Detection Algorithm of Football Events in Videos

Unsupervised Temporal Feature Aggregation for Event Detection in Unstructured Sports Videos

Automated soccer event detection and highlight generation for short and long views

Exciting Event Detection in Broadcast Soccer Video with Mid-Level Description and Incremental Learning

Automatic video genre categorization and event detection techniques on large-scale sports data

Feature Combination Meets Attention: Baidu Soccer Embeddings and Transformer based Temporal Detection

Soccer: Who Has the Ball? Generating Visual Analytics and Player Statistics.

Effective video event detection via subspace projection

Semantic event detection via multimodal data mining

Offense based temporal segmentation for event detection in soccer video.