Abstract:Object tracking is one of the most advanced applications of computer vision algorithms. While various tracking approaches have been previously developed, they often use many approximations and assumptions to enable real-time performance within the resource constraints in terms of memory, time and computational requirements. In order to address these limitations, we investigate the bottlenecks of existing tracking frameworks and propose a solution to enhance tracking efficiency. The proposed method uses Locality Sensitive Hashing (LSH) to efficiently store and retrieve nearest neighbours and then utilizes a bipartite cost matching based on the predicted positions, size, aspect ratio, appearance description, and uncertainty in motion estimation. The LSH algorithm helps reduce the dimensionality of the data while preserving their relative distances. LSH hashes the features in constant time and facilitates rapid nearest neighbour retrieval by considering features falling into the same hash buckets as similar. The effectiveness of the method was evaluated on the MOT benchmark dataset and achieved Multiple Object Tracker Accuracy (MOTA) of 67.1% (train) and 62.7% (test). Furthermore, our framework exhibits the highest Multiple Object Tracker Precision (MOTP), mostly tracked objects, and the lowest values for mostly lost objects and identity switches among the state-of-the-art trackers. The incorporation of LSH implementation reduced identity switches by approximately 7% and fragmentation by around 13%. We used the framework for real-time tracking applications on edge devices for an industry partner. We found that the LSH integration resulted in a notable reduction in track ID switching, with only a marginal increase in computation.

Multiple Object Trackers in OpenCV: A Benchmark

Exploit the Connectivity: Multi-Object Tracking with TrackletNet

MOTChallenge: A Benchmark for Single-Camera Multiple Target Tracking

The Visual Object Tracking VOT2013 Challenge Results

Tracking Every Thing in the Wild.

TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild

OVTrack: Open-Vocabulary Multiple Object Tracking

OCTrack: Benchmarking the Open-Corpus Multi-Object Tracking

The Visual Object Tracking VOT2014 Challenge Results

Multiple Object Tracking in Deep Learning Approaches: A Survey

A Survey of Multi-object Video Tracking Algorithms

Exploring the State-of-the-Art in Multi-Object Tracking: A Comprehensive Survey, Evaluation, Challenges, and Future Directions

BoostTrack: boosting the similarity measure and detection confidence for improved multiple object tracking

VariabilityTrack:Multi-Object Tracking with Variable Speed Object Movement

BoostTrack++: using tracklet information to detect more objects in multiple object tracking

Real-time Multi-Object Tracking Based on Bi-directional Matching

A Review of Detection-Related Multiple Object Tracking in Recent Times

Development of a multi-object tracking algorithm with untrained features of object matching

TPTrack: Strengthening tracking-by-detection methods from tracklet processing perspectives

Improved multi object tracking with locality sensitive hashing

Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics