Abstract:Abstract Standardized benchmarks have been crucial in pushing the performance of computer vision algorithms, especially since the advent of deep learning. Although leaderboards should not be over-claimed, they often provide the most objective measure of performance and are therefore important guides for research. We present MOTChallenge , a benchmark for single-camera Multiple Object Tracking (MOT) launched in late 2014, to collect existing and new data and create a framework for the standardized evaluation of multiple object tracking methods. The benchmark is focused on multiple people tracking, since pedestrians are by far the most studied object in the tracking community, with applications ranging from robot navigation to self-driving cars. This paper collects the first three releases of the benchmark: (i) MOT15 , along with numerous state-of-the-art results that were submitted in the last years, (ii) MOT16 , which contains new challenging videos, and (iii) MOT17 , that extends MOT16 sequences with more precise labels and evaluates tracking performance on three different object detectors. The second and third release not only offers a significant increase in the number of labeled boxes, but also provide labels for multiple object classes beside pedestrians, as well as the level of visibility for every single object of interest. We finally provide a categorization of state-of-the-art trackers and a broad error analysis. This will help newcomers understand the related work and research trends in the MOT community, and hopefully shed some light into potential future research directions.

Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics

MONCE Tracking Metrics: a comprehensive quantitative performance evaluation methodology for object tracking

Tracking Every Thing in the Wild.

AB3DMOT: A Baseline for 3D Multi-Object Tracking and New Evaluation Metrics

MOTChallenge: A Benchmark for Single-Camera Multiple Target Tracking

New Performance Measures for Object Tracking under Complex Environments

Multi-features Guided Robust Visual Tracking.

Evaluation of a Laser-based Multi-people Detection and Tracking System

InterTrack: Interaction Transformer for 3D Multi-Object Tracking

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

MAT: Motion-Aware Multi-Object Tracking

A Novel Performance Evaluation Method for Visual Tracking Methods

Performance Measures and a Data Set for Multi-target, Multi-camera Tracking

An Uncertainty-Aware Performance Measure for Multi-Object Tracking

Multiple Object Trackers in OpenCV: A Benchmark

MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Tracking

A protocol for evaluating video trackers under real-world conditions

MCTrack: A Unified 3D Multi-Object Tracking Framework for Autonomous Driving

Visual Object Tracking With Mutual Affinity Aligned to Human Intuition

DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustment

A time-weighted metric for sets of trajectories to assess multi-object tracking algorithms