Abstract:Joint Detection and Embedding (JDE) trackers have demonstrated excellent performance in Multi-Object Tracking (MOT) tasks by incorporating the extraction of appearance features as auxiliary tasks through embedding Re-Identification task (ReID) into the detector, achieving a balance between inference speed and tracking performance. However, solving the competition between the detector and the feature extractor has always been a challenge. Meanwhile, the issue of directly embedding the ReID task into MOT has remained unresolved. The lack of high discriminability in appearance features results in their limited utility. In this paper, a new learning approach using cross-correlation to capture temporal information of objects is proposed. The feature extraction network is no longer trained solely on appearance features from each frame but learns richer motion features by utilizing feature heatmaps from consecutive frames, which addresses the challenge of inter-class feature similarity. Furthermore, our learning approach is applied to a more lightweight feature extraction network, and treat the feature matching scores as strong cues rather than auxiliary cues, with an appropriate weight calculation to reflect the compatibility between our obtained features and the MOT task. Our tracker, named TCBTrack, achieves state-of-the-art performance on multiple public benchmarks, i.e., MOT17, MOT20, and DanceTrack datasets. Specifically, on the DanceTrack test set, we achieve 56.8 HOTA, 58.1 IDF1 and 92.5 MOTA, making it the best online tracker capable of achieving real-time performance. Comparative evaluations with other trackers prove that our tracker achieves the best balance between speed, robustness and accuracy. Code is available at <a class="link-external link-https" href="https://github.com/yfzhang1214/TCBTrack" rel="external noopener nofollow">this https URL</a>.

A Novel Deep Learning Based Time-Varying Multipath Component Tracking Algorithm

A Framework of Automatic Clustering and Tracking for Time-Variant Multipath Components

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Time-Varying Channel Prediction for RIS-Assisted MU-MISO Networks Via Deep Learning

Adaptive CDMA Multipath Delay Trackerfor Closely Spaced Multipaths

Deep Feature Tracker: A Novel Application for Deep Convolutional Neural Networks

Time Convolutional Network-Based Maneuvering Target Tracking with Azimuth–Doppler Measurement

A Varying-Parameter Complementary Neural Network for Multi-Robot Tracking and Formation Via Model Predictive Control

Tracking Sparse mmWave Channel under Time Varying Multipath Scatterers

Deep Learning for Channel Estimation and Tracking in Vehicular to Infrastructure Communications

MPC-TD3 Trajectory Tracking Control for Electrically Driven Unmanned Tracked Vehicles

Deep Learning-based Channel Estimation Approach for 3D Massive MIMO Millimeter-Wave System in Time-Varying Environments.

Deep Learning for Channel Tracking in IRS-Assisted UAV Communication Systems

MobileTrack: Siamese Efficient Mobile Network for High‐speed UAV Tracking

Time Varying Channel Tracking with Spatial and Temporal BEM for Massive MIMO Systems

MM-Tracker: Visual Tracking with A Multi-Task Model Integrating Detection and Differentiating Feature Extraction

A Novel Multi-Target Track Initiation Method Based on Convolution Neural Network

Real-Time Multiple Pedestrians Tracking in Multi-camera System

Deep Feature Tracking Based on Interactive Multiple Model.

Path tracking control of unmanned ground vehicles considering the signal time delay

Temporal Correlation Meets Embedding: Towards a 2nd Generation of JDE-based Real-Time Multi-Object Tracking