Abstract:In this article, we propose a novel and effective system based on multiple cameras to extract the events for soccer matches. A precise ontological definition of the soccer events is still an open point. According to our definition, the events include the free kick, corner kick, penalty kick and the goal, because they are the representative shots for the audience to watch. The events are very important for highlights selection and sport data analysis. At present, the events including the ball and players information are selected and labeled manually from the images, which is a big workload for the staffs. Addressing this problem, our system provides an automatic extraction of the events. For soccer videos, our system first uses the local-based deep neural network for the ball and player detection from the input images. Then, we handle with the ball and player bounding boxes separately. For players, a player can be labeled as one of the three types: two teams or the referee, and a novel unsupervised U-encoder is designed for the player labeling. For soccer ball, the application of multiple cameras allows us to refine the ball detection results. We can get the world coordinate of ball according to the camera parameters and then rebuild the ball trajectory and the court in a top view. Based on the reconstructed map, we get the soccer events by motion analysis of ball trajectory and then apply the ball location and player classification results to display the events for each camera. The test results on real videos of European soccer league show the good detection and labeling performance of our system. We find all the events in the test videos. Our proposed system can deal with many complex cases such as occlusion and pose variation that happen frequently in real applications.

A decision tree-based multimodal data mining framework for soccer goal detection

Semantic event detection via multimodal data mining

Multi-Mode Semantic Cues Based on Hidden Conditional Random Field in Soccer Video

Multimodal feature extraction and fusion for semantic mining of soccer video: a survey

Event Detection In Basketball Video Using Multiple Modalities

Semantic Event Extraction From Basketball Games Using Multi-Modal Analysis

A Unified Framework for Semantic Shot Classification in Sports Videos

Towards Universal Soccer Video Understanding

Sports Video Mining with Mosaic

Event Analysis in Soccer Video by Dynamic Programming Based Fusion of Multiple Modalities

Enhanced Sports Video Shot Transition Detection Based on a Unified Feature Model

A Fusion Scheme of Visual and Auditory Modalities for Event Detection in Sports Video.

An Automatic Multi-Camera-based Event Extraction System for Real Soccer Videos.

Deep Understanding of Soccer Match Videos

A Semi-Automatic Feature Selecting Method For Sports Video Highlight Annotation

A statistical framework for replay detection in soccer video

Enhanced Shot Change Detection using Motion Features for Soccer Video Analysis.

Mining Information of Attack-Defense Status from Soccer Video Based on Scene Analysis

A mid-level representation framework for semantic sports video analysis.

Enhanced Sports Video Shot Boundary Detection Based on Middle Level Features and a Unified Model

A Unified Framework for Semantic Shot Representation of Sports Video