Abstract:Joint Detection and Embedding (JDE) trackers have demonstrated excellent performance in Multi-Object Tracking (MOT) tasks by incorporating the extraction of appearance features as auxiliary tasks through embedding Re-Identification task (ReID) into the detector, achieving a balance between inference speed and tracking performance. However, solving the competition between the detector and the feature extractor has always been a challenge. Meanwhile, the issue of directly embedding the ReID task into MOT has remained unresolved. The lack of high discriminability in appearance features results in their limited utility. In this paper, a new learning approach using cross-correlation to capture temporal information of objects is proposed. The feature extraction network is no longer trained solely on appearance features from each frame but learns richer motion features by utilizing feature heatmaps from consecutive frames, which addresses the challenge of inter-class feature similarity. Furthermore, our learning approach is applied to a more lightweight feature extraction network, and treat the feature matching scores as strong cues rather than auxiliary cues, with an appropriate weight calculation to reflect the compatibility between our obtained features and the MOT task. Our tracker, named TCBTrack, achieves state-of-the-art performance on multiple public benchmarks, i.e., MOT17, MOT20, and DanceTrack datasets. Specifically, on the DanceTrack test set, we achieve 56.8 HOTA, 58.1 IDF1 and 92.5 MOTA, making it the best online tracker capable of achieving real-time performance. Comparative evaluations with other trackers prove that our tracker achieves the best balance between speed, robustness and accuracy. Code is available at <a class="link-external link-https" href="https://github.com/yfzhang1214/TCBTrack" rel="external noopener nofollow">this https URL</a>.

EmbedTrack -- Simultaneous Cell Segmentation and Tracking Through Learning Offsets and Clustering Bandwidths

Track Without Appearance: Learn Box and Tracklet Embedding with Local and Global Motion Patterns for Vehicle Tracking

VoxelEmbed: 3D Instance Segmentation and Tracking with Voxel Embedding based Deep Learning

Enhancing Cell Tracking with a Time-Symmetric Deep Learning Approach

Celltrack R-CNN: A Novel End-To-End Deep Neural Network for Cell Segmentation and Tracking in Microscopy Images

Ultrack: pushing the limits of cell tracking across biological scales

Large-Scale Multi-Hypotheses Cell Tracking Using Ultrametric Contours Maps

SC-Track: a robust cell tracking algorithm for generating accurate single-cell lineages from diverse cell segmentations

SC-Track: a robust cell-tracking algorithm for generating accurate single-cell lineages from diverse cell segmentations

Faster Mean-shift: GPU-accelerated clustering for cosine embedding-based cell segmentation and tracking

Deep Learning Method for Cell-Wise Object Tracking, Velocity Estimation and Projection of Sensor Data over Time

DMNet: Dual-Stream Marker Guided Deep Network for Dense Cell Segmentation and Lineage Tracking

Cell Tracking Using Deep Neural Networks with Multi-Task Learning

Graph Neural Network for Cell Tracking in Microscopy Videos

Cell Tracking via Proposal Generation and Selection

Trackastra: Transformer-based cell tracking for live-cell microscopy

A Robust Cell Tracking Framework by Fusing Global and Local Optimization Algorithms

DEFT: Detection Embeddings for Tracking

Temporal Correlation Meets Embedding: Towards a 2nd Generation of JDE-based Real-Time Multi-Object Tracking

EllipTrack: A Global-Local Cell-Tracking Pipeline for 2D Fluorescence Time-Lapse Microscopy