Abstract:Accurate and reliable tracking of multi-pedestrian is of great importance for autonomous driving, human-robot interaction and video surveillance. Since different scenarios have different best-performing sensors, sensor fusion perception plans are believed to have complementary modalities and be capable of handling situations which are challenging for single sensor. In this paper, we propose a novel track-to-track fusion strategy for multi-pedestrian tracking by using a millimeter-wave (MMW) radar and a monocular camera. Pedestrians are firstly tracked by each sensor according to the sensor characteristic. Specifically, the 3D monocular pedestrian detections are obtained by a convolutional neural network (CNN). The trajectory is formed by the tracking-by-detection approach, combined with Bayesian estimation. The measurement noise of the 3D monocular detection is modeled by a detection uncertainty value obtained from the same CNN, as an approach to estimate the pedestrian state more accurately. The MMW radar utilizes the track-before-detection method due to the sparseness of the radar features. Afterwards, the pedestrian trajectories are obtained by the proposed track-to-track fusion strategy, which can work adaptively under challenging weather conditions, low-illumination conditions and clutter scenarios. A group of tests are carried out to validate our pedestrian tracking strategy. Tracking trajectories and optimal sub-pattern assignment (OSPA) metric demonstrate the accuracy and robustness of the proposed multi-sensor multi-pedestrian tracking system.

Air-platform multi-radar anti-bias tracks association algorithm

Anti-Bias Track-To-Track Association Algorithm Based on Distance Detection

Anti-bias Track-to-Track Association Algorithm for Aircraft Platforms Based on Distance Hierarchical Clustering

Multi-radar Anti-Bias Track Association Based on the Reference Topology Feature

A track association algorithm for distributed multi-target systems based on gray interval numbers

Passive tracking and data association algorithm for multiple targets with single sensor

Research on joint data association and bias estimation method in radar networks

On Anti-Bias Track Association Algorithm Based on Course Reference Matching

Joint Association and Registration in a Multiradar System for Migratory Insect Track Observation

Misassociation detection method based on the residual errors of system bias estimation

Radar System Error Registration Algorithm Based on Data Link

Analytic Performance Prediction Of Track-To-Track Association With Biased Data In Multi-Sensor Multi-Target Tracking Scenarios

A Probability Hypothesis Density Filter and Data Association Based Algorithm for Multitarget Tracking with Pulse Doppler Radar

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Track-To-Track Association Using Reference Topology in the Presence of Sensor Bias

Track-to-Track Association Technique in Radar Network in the Presence of Systematic Errors

Multi-Target Tracking Algorithm Combined with High-Precision Map

Reference Pattern-Based Track-to-track Association with Biased Data

Multiple Targets Tracking Based on Cross Sector Probability Hypothesis Density Filter in Radar System.

Adaptive detectors with diagonal loading for airborne multi-input multi-output radar

Centralized multi-sensor general association algorithm