Abstract:In this paper, we present a novel 2D⁻3D pedestrian tracker designed for applications in autonomous vehicles. The system operates on a tracking by detection principle and can track multiple pedestrians in complex urban traffic situations. By using a behavioral motion model and a non-parametric distribution as state model, we are able to accurately track unpredictable pedestrian motion in the presence of heavy occlusion. Tracking is performed independently, on the image and ground plane, in global, motion compensated coordinates. We employ Camera and LiDAR data fusion to solve the association problem where the optimal solution is found by matching 2D and 3D detections to tracks using a joint log-likelihood observation model. Each 2D⁻3D particle filter then updates their state from associated observations and a behavioral motion model. Each particle moves independently following the pedestrian motion parameters which we learned offline from an annotated training dataset. Temporal stability of the state variables is achieved by modeling each track as a Markov Decision Process with probabilistic state transition properties. A novel track management system then handles high level actions such as track creation, deletion and interaction. Using a probabilistic track score the track manager can cull false and ambiguous detections while updating tracks with detections from actual pedestrians. Our system is implemented on a GPU and exploits the massively parallelizable nature of particle filters. Due to the Markovian nature of our track representation, the system achieves real-time performance operating with a minimal memory footprint. Exhaustive and independent evaluation of our tracker was performed by the KITTI benchmark server, where it was tested against a wide variety of unknown pedestrian tracking situations. On this realistic benchmark, we outperform all published pedestrian trackers in a multitude of tracking metrics.

Privacy-preserving pedestrian tracking with path image inpainting and 3D point cloud features

Privacy-preserving Pedestrian Tracking using Distributed 3D LiDARs

Real‐time 3D multi‐pedestrian detection and tracking using 3D LiDAR point cloud for mobile robot

Behavioral Pedestrian Tracking Using a Camera and LiDAR Sensors on a Moving Vehicle

Density Enhancement-Based Long-Range Pedestrian Detection Using 3-D Range Data

RPEA: A Residual Path Network with Efficient Attention for 3D pedestrian detection from LiDAR point clouds

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Tracking pedestrian by using multiple laser range scanners

Fusion-attention network using dense scale-invariant feature transform flow image and point cloud for 3D pedestrian detection

Real-Time Pedestrian Detection and Tracking Based on YOLOv3

Pedestrian Tracking Using Single-row Laser Range Scanners.

Real-Time 3D Object Detection on Crowded Pedestrians

Tracking A Variable Number of Pedestrians in Crowded Scenes by Using Laser Range Scanners

Efficient Detection and Tracking of Human Using 3D LiDAR Sensor

Leveraging 3D LiDAR Sensors to Enable Enhanced Urban Safety and Public Health: Pedestrian Monitoring and Abnormal Activity Detection

A Novel System for Tracking Pedestrians Using Multiple Single-Row Laser-Range Scanners

Detection and Tracking of Multiple Pedestrians by Using Laser Range Scanners

Spb3DTracker: A Robust LiDAR-Based Person Tracker for Noisy Environment

Accurate and Real-Time 3D Pedestrian Detection Using an Efficient Attentive Pillar Network

Intelligent Video Analysis: A Pedestrian Trajectory Extraction Method for the Whole Indoor Space Without Blind Areas

Multiple pedestrian tracking using LiDAR network in complex indoor scenarios