Abstract:In this article, we present a method to perform automatic player trajectories mapping based on player detection, unsupervised labeling, efficient multi-object tracking, and playfield registration in broadcast soccer videos. Player detector determines the players' positions and scales by combining the ability of dominant color based background subtraction and a boosting detector with Haar features. We first learn the dominant color with accumulate color histogram at the beginning of processing, then use the player detector to collect hundreds of player samples, and learn player appearance codebook by unsupervised clustering. In a soccer game, a player can be labeled as one of four categories: two teams, referee or outlier. The learning capability enables the method to be generalized well to different videos without any manual initialization. With the dominant color and player appearance model, we can locate and label each player. After that, we perform multi-object tracking by using Markov Chain Monte Carlo (MCMC) data association to generate player trajectories. Some data driven dynamics are proposed to improve the Markov chain's efficiency, such as label consistency, motion consistency, and track length, etc. Finally, we extract key-points and find the mapping from an image plane to the standard field model, and then map players' position and trajectories to the field. A large quantity of experimental results on FIFA World Cup 2006 videos demonstrate that this method can reach high detection and labeling precision, reliably tracking in scenes of player occlusion, moderate camera motion and pose variation, and yield promising field registration results.

Open Dataset Recorded by Single Cameras for Multi-Player Tracking in Soccer Scenarios

A Novel Dataset for Multi-View Multi-Player Tracking in Soccer Scenarios

SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos

A survey on soccer player detection and tracking with videos

A Novel LiDAR-Camera Fused Player Tracking System in Soccer Scenarios

TeamTrack: A Dataset for Multi-Sport Multi-Object Tracking in Full-pitch Videos

Graph-Based Multi-Camera Soccer Player Tracker

Automatic player labeling, tracking and field registration and trajectory mapping in broadcast soccer video

Automatic Player Detection, Labeling and Tracking in Broadcast Soccer Video

Multi-camera Video Surveillance for Real-Time Analysis and Reconstruction of Soccer Games

MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actions

SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenes

Soccer player tracking and data correction based on attention with full-field videos

GTA: Global Tracklet Association for Multi-Object Tracking in Sports

Real-time 3D Soccer Ball Tracking from Multiple Cameras

Scaling up SoccerNet with multi-view spatial localization and re-identification

Self-Supervised Small Soccer Player Detection and Tracking

Soccer match broadcast video analysis method based on detection and tracking

TGRMPT: A Head-Shoulder Aided Multi-Person Tracker and a New Large-Scale Dataset for Tour-Guide Robot

Real-Time Modeling of 3-D Soccer Ball Trajectories from Multiple Fixed Cameras.

Multiple Player Tracking in Sports Video: A Dual-Mode Two-Way Bayesian Inference Approach with Progressive Observation Modeling