Abstract:In this article, we present a method to perform automatic player trajectories mapping based on player detection, unsupervised labeling, efficient multi-object tracking, and playfield registration in broadcast soccer videos. Player detector determines the players' positions and scales by combining the ability of dominant color based background subtraction and a boosting detector with Haar features. We first learn the dominant color with accumulate color histogram at the beginning of processing, then use the player detector to collect hundreds of player samples, and learn player appearance codebook by unsupervised clustering. In a soccer game, a player can be labeled as one of four categories: two teams, referee or outlier. The learning capability enables the method to be generalized well to different videos without any manual initialization. With the dominant color and player appearance model, we can locate and label each player. After that, we perform multi-object tracking by using Markov Chain Monte Carlo (MCMC) data association to generate player trajectories. Some data driven dynamics are proposed to improve the Markov chain's efficiency, such as label consistency, motion consistency, and track length, etc. Finally, we extract key-points and find the mapping from an image plane to the standard field model, and then map players' position and trajectories to the field. A large quantity of experimental results on FIFA World Cup 2006 videos demonstrate that this method can reach high detection and labeling precision, reliably tracking in scenes of player occlusion, moderate camera motion and pose variation, and yield promising field registration results.

Segmentation of Players and Team Discrimination in Soccer Videos

Semantic Video Shot Segmentation Based on Color Ratio Feature and SVM

Mid-Level Descriptors Extraction of Soccer Video with Domain Knowledge

Automatic Player Detection, Labeling and Tracking in Broadcast Soccer Video

Deep Understanding of Soccer Match Videos

Automatic Extraction Of Semantic Colors In Sports Video

A new method to segment playfield and its applications in match analysis in sports video.

Enhanced Shot Change Detection using Motion Features for Soccer Video Analysis.

Automatic player labeling, tracking and field registration and trajectory mapping in broadcast soccer video

A statistical framework for replay detection in soccer video

Extracting 3D information from broadcast soccer video

Soccer: Who Has the Ball? Generating Visual Analytics and Player Statistics.

Content-based Sports Video Analysis and Modeling

A survey on soccer player detection and tracking with videos

A Sports Video Behavior Recognition Using Local Spatiotemporal Patterns

Video-based Analysis of Soccer Matches

Offense based temporal segmentation for event detection in soccer video.

Soccer match broadcast video analysis method based on detection and tracking

Towards Universal Soccer Video Understanding

Mean Shift Based Video Segment Representation And Applications To Replay Detection

EIoU-distance loss: an automated team-wise player detection and tracking with jersey colour recognition in soccer