Abstract:In this article, we propose a novel and effective system based on multiple cameras to extract the events for soccer matches. A precise ontological definition of the soccer events is still an open point. According to our definition, the events include the free kick, corner kick, penalty kick and the goal, because they are the representative shots for the audience to watch. The events are very important for highlights selection and sport data analysis. At present, the events including the ball and players information are selected and labeled manually from the images, which is a big workload for the staffs. Addressing this problem, our system provides an automatic extraction of the events. For soccer videos, our system first uses the local-based deep neural network for the ball and player detection from the input images. Then, we handle with the ball and player bounding boxes separately. For players, a player can be labeled as one of the three types: two teams or the referee, and a novel unsupervised U-encoder is designed for the player labeling. For soccer ball, the application of multiple cameras allows us to refine the ball detection results. We can get the world coordinate of ball according to the camera parameters and then rebuild the ball trajectory and the court in a top view. Based on the reconstructed map, we get the soccer events by motion analysis of ball trajectory and then apply the ball location and player classification results to display the events for each camera. The test results on real videos of European soccer league show the good detection and labeling performance of our system. We find all the events in the test videos. Our proposed system can deal with many complex cases such as occlusion and pose variation that happen frequently in real applications.

Semantic Event Extraction From Basketball Games Using Multi-Modal Analysis

Event Detection In Basketball Video Using Multiple Modalities

Creating Personalized Video Summaries Via Semantic Event Detection

Using Webcast Text for Semantic Event Detection in Broadcast Sports Video

Semantic event detection via multimodal data mining

Live Sports Event Detection Based on Broadcast Video and Web-Casting Text

Fusing Motion Patterns and Key Visual Information for Semantic Event Recognition in Basketball Videos

A mid-level representation framework for semantic sports video analysis.

A Hmm Based Semantic Analysis Framework For Sports Game Event Detection

A Fusion Scheme of Visual and Auditory Modalities for Event Detection in Sports Video.

An Automatic Multi-Camera-based Event Extraction System for Real Soccer Videos.

Event Analysis in Soccer Video by Dynamic Programming Based Fusion of Multiple Modalities

On Semantic Annotation for Sports Video Highlights by Mining User Comments from Live Broadcast Social Network

Modality Mixture Projections for Semantic Video Event Detection

Multimodal feature extraction and fusion for semantic mining of soccer video: a survey

A Unified Framework for Semantic Shot Classification in Sports Videos

Multi-Mode Semantic Cues Based on Hidden Conditional Random Field in Soccer Video

Bi-Level Semantic Representation Analysis for Multimedia Event Detection

Player Action Recognition in Broadcast Tennis Video with Applications to Semantic Analysis of Sports Game

Semantic Shot Classification in Sports Video

A Multi-Modal Transformer Approach for Football Event Classification