Abstract:Accurate and reliable tracking of multi-pedestrian is of great importance for autonomous driving, human-robot interaction and video surveillance. Since different scenarios have different best-performing sensors, sensor fusion perception plans are believed to have complementary modalities and be capable of handling situations which are challenging for single sensor. In this paper, we propose a novel track-to-track fusion strategy for multi-pedestrian tracking by using a millimeter-wave (MMW) radar and a monocular camera. Pedestrians are firstly tracked by each sensor according to the sensor characteristic. Specifically, the 3D monocular pedestrian detections are obtained by a convolutional neural network (CNN). The trajectory is formed by the tracking-by-detection approach, combined with Bayesian estimation. The measurement noise of the 3D monocular detection is modeled by a detection uncertainty value obtained from the same CNN, as an approach to estimate the pedestrian state more accurately. The MMW radar utilizes the track-before-detection method due to the sparseness of the radar features. Afterwards, the pedestrian trajectories are obtained by the proposed track-to-track fusion strategy, which can work adaptively under challenging weather conditions, low-illumination conditions and clutter scenarios. A group of tests are carried out to validate our pedestrian tracking strategy. Tracking trajectories and optimal sub-pattern assignment (OSPA) metric demonstrate the accuracy and robustness of the proposed multi-sensor multi-pedestrian tracking system.

Misassociation detection method based on the residual errors of system bias estimation

Multi-Sensor Track-to-Track Association and Spatial Registration Algorithm Under Incomplete Measurements

Track Fusion Algorithm with Residual Bias Modeling and Compensation

Anti-Bias Track-To-Track Association Algorithm Based on Distance Detection

Passive tracking and data association algorithm for multiple targets with single sensor

Robust Registration under Inaccurate Track Association in Multi-sensor Fusion

A Multi-sensor Data Fusion Method Based on the Set-Pair Identity Degree and Connection Number

Air-platform multi-radar anti-bias tracks association algorithm

On Anti-Bias Track Association Algorithm Based on Course Reference Matching

Track-To-Track Association Using Reference Topology in the Presence of Sensor Bias

A Novel Fuzzy Pattern Recognition Data Association Method for Biased Sensor Data.

A Joint Maximum Likelihood Algorithm for Simultaneous Track Correlation and Sensorbias Estimation

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Real-time Detection of Systematic Errors in Distributed Sensors

Track-to-Track Association Technique in Radar Network in the Presence of Systematic Errors

Bias fusion estimation for multi-target tracking systems with multiple asynchronous sensors

Detection, tracking and recognition of multi-targets using fusion data from different sensors

Anti-bias Track-to-Track Association Algorithm for Aircraft Platforms Based on Distance Hierarchical Clustering

Research on joint data association and bias estimation method in radar networks

Analytic Performance Prediction Of Track-To-Track Association With Biased Data In Multi-Sensor Multi-Target Tracking Scenarios

A track association algorithm for distributed multi-target systems based on gray interval numbers