Abstract:In this paper, we present a novel 2D⁻3D pedestrian tracker designed for applications in autonomous vehicles. The system operates on a tracking by detection principle and can track multiple pedestrians in complex urban traffic situations. By using a behavioral motion model and a non-parametric distribution as state model, we are able to accurately track unpredictable pedestrian motion in the presence of heavy occlusion. Tracking is performed independently, on the image and ground plane, in global, motion compensated coordinates. We employ Camera and LiDAR data fusion to solve the association problem where the optimal solution is found by matching 2D and 3D detections to tracks using a joint log-likelihood observation model. Each 2D⁻3D particle filter then updates their state from associated observations and a behavioral motion model. Each particle moves independently following the pedestrian motion parameters which we learned offline from an annotated training dataset. Temporal stability of the state variables is achieved by modeling each track as a Markov Decision Process with probabilistic state transition properties. A novel track management system then handles high level actions such as track creation, deletion and interaction. Using a probabilistic track score the track manager can cull false and ambiguous detections while updating tracks with detections from actual pedestrians. Our system is implemented on a GPU and exploits the massively parallelizable nature of particle filters. Due to the Markovian nature of our track representation, the system achieves real-time performance operating with a minimal memory footprint. Exhaustive and independent evaluation of our tracker was performed by the KITTI benchmark server, where it was tested against a wide variety of unknown pedestrian tracking situations. On this realistic benchmark, we outperform all published pedestrian trackers in a multitude of tracking metrics.

Real-time On and Off Road GPS Tracking

Urban Network-Wide Traffic Speed Estimation with Massive Ride-Sourcing GPS Traces

On-Road Vehicle Tracking Using Part-Based Particle Filter

Road-Map Aided GM-PHD Filter for Multivehicle Tracking With Automotive Radar

Cooperative Path Following Control in Autonomous Vehicles Graphical Games: A Data-Based Off-Policy Learning Approach

Map matching when the map is wrong: Efficient vehicle tracking on- and off-road for map learning

Principal Component Analysis Neural Network Based Probabilistic Tracking of Unpaved Road

Generic Vehicle Tracking Framework Capable of Handling Occlusions Based on Modified Mixture Particle Filter

Behavioral Pedestrian Tracking Using a Camera and LiDAR Sensors on a Moving Vehicle

Online Active Set-Based Longitudinal and Lateral Model Predictive Tracking Control of Electric Autonomous Driving

Bayesian Simultaneous Localization and Multi-Lane Tracking Using Onboard Sensors and a SD Map

Efficient Online Vehicle Tracking for Real—Virtual Mapping Systems

Deriving Network-Constrained Trajectories from Sporadic Tracking Points Collected in Location-Based Services

Parameter-Free State Estimation Based on Kalman Filter with Attention Learning for GPS Tracking in Autonomous Driving System

NoisyOTNet: A Robust Real-Time Vehicle Tracking Model for Traffic Surveillance

Accurate Vehicle Position Estimation Using a Kalman Filter and Neural Network-Based Approach.

Tracking Multiple Vehicles Constrained to a Road Network From a UAV with Sparse Visual Measurements

Online Multi-Target Tracking for Maneuvering Vehicles in Dynamic Road Context

Multi-Vehicle Tracking Using an Environment Interaction Potential Force Model

Freeway Traffic State Estimation: A Lagrangian-space Kalman Filter Approach

RoadRunner -- Learning Traversability Estimation for Autonomous Off-road Driving