Abstract:The authors propose a deep‐learning framework, CTGMOT, for multi‐object tracking (MOT) in complex team sports videos. The backbone network of the framework combines CNN and Transformers to extract local and global features, and uses parallel decoders to fuse appearance and motion features. To accurately capture spatial‐temporal correlations, the framework adopts GNN and an attention mechanism to fuse the spatial tracking features of objects within frames as well as the temporal tracking features across different frames, which better distinguishes fast‐moving and occluded targets and improves the performance of online MOT. In response to the challenges of Multi‐Object Tracking (MOT) in sports scenes, such as severe occlusions, similar appearances, drastic pose changes, and complex motion patterns, a deep‐learning framework CTGMOT (CNN‐Transformer‐GNN‐based MOT) specifically for multiple athlete tracking in sports videos that performs joint modelling of detection, appearance and motion features is proposed. Firstly, a detection network that combines Convolutional Neural Networks (CNN) and Transformers is constructed to extract both local and global features from images. The fusion of appearance and motion features is achieved through a design of parallel dual‐branch decoders. Secondly, graph models are built using Graph Neural Networks (GNN) to accurately capture the spatio‐temporal correlations between object and trajectory features from inter‐frame and intra‐frame associations. Experimental results on the public sports tracking dataset SportsMOT show that the proposed framework outperforms other state‐of‐the‐art methods for MOT in complex sport scenes. In addition, the proposed framework shows excellent generality on benchmark datasets MOT17 and MOT20.

Multi-camera 3D Ball Tracking Framework for Sports Video.

Real-time 3D Football Ball Tracking from Multiple Cameras

Real-time 3D Soccer Ball Tracking from Multiple Cameras

A Three-Level Scheme For Real-Time Ball Tracking

Real-Time Modeling of 3-D Soccer Ball Trajectories from Multiple Fixed Cameras.

Tracking the Soccer Ball Using Multiple Fixed Cameras

Design and Implementation of A Soccer Ball Detection System with Multiple Cameras

A General Framework for 3d Soccer Ball Estimation and Tracking

Multi-feature based high-speed ball shape target tracking

Multi-camera Video Surveillance for Real-Time Analysis and Reconstruction of Soccer Games

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

Extracting 3D information from broadcast soccer video

Robust multi-object tracking via cross-domain contextual information for sports video analysis

A Novel Dataset for Multi-View Multi-Player Tracking in Soccer Scenarios

Visual Tracking Of Players Through Occlusions In Low Resolution

Enhanced Multi-Object Tracking Using Pose-based Virtual Markers in 3x3 Basketball

A deep learning framework for multi‐object tracking in team sports videos

A novel ball tracking method using dynamic kalman filter with two-stage ball search

A Novel LiDAR-Camera Fused Player Tracking System in Soccer Scenarios

A scheme for ball detection and tracking in broadcast soccer video

MambaTrack: A Simple Baseline for Multiple Object Tracking with State Space Model