Abstract:Roadside perception is a key component in intelligent transportation systems. In this paper, we present a novel three-dimensional (3D) extended object tracking (EOT) method, which simultaneously estimates the object kinematics and extent state, in roadside perception using both the radar and camera data. Because of the influence of sensor viewing angle and limited angle resolution, radar measurements from objects are sparse and non-uniformly distributed, leading to inaccuracies in object extent and position estimation. To address this problem, we present a novel spherical Gaussian function weighted Gaussian mixture model. This model assumes that radar measurements originate from a series of probabilistic weighted radar reflectors on the vehicle's extent. Additionally, we utilize visual detection of vehicle keypoints to provide additional information on the positions of radar reflectors. Since keypoints may not always correspond to radar reflectors, we propose an elastic skeleton fusion mechanism, which constructs a virtual force to establish the relationship between the radar reflectors on the vehicle and its extent. Furthermore, to better describe the kinematic state of the vehicle and constrain its extent state, we develop a new 3D constant turn rate and velocity motion model, considering the complex 3D motion of the vehicle relative to the roadside sensor. Finally, we apply variational Bayesian approximation to the intractable measurement update step to enable recursive Bayesian estimation of the object's state. Simulation results using the Carla simulator and experimental results on the nuScenes dataset demonstrate the effectiveness and superiority of the proposed method in comparison to several state-of-the-art 3D EOT methods.

Dynamical Tracking of Surrounding Objects for Road Vehicles Using Linearly-Arrayed Ultrasonic Sensors.

Kalman Filter-Based Tracking of Moving Objects Using Linear Ultrasonic Sensor Array for Road Vehicles

Indoor Wireless Positioning Utilizing WSN and Machine Vision

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

Detection and Tracking of Campus Road Based on Four-Line Laser Radar

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Real-time dynamic obstacle detection and tracking using 3D Lidar

Road-Map Aided GM-PHD Filter for Multivehicle Tracking With Automotive Radar

Networked Ultrasonic Sensors for Target Tracking: An Experimental Study

Dynamic Object Tracking for Self-Driving Cars Using Monocular Camera and LIDAR.

3D Extended Object Tracking by Fusing Roadside Sparse Radar Point Clouds and Pixel Keypoints

Omni-directional Detection and Tracking of On-Road Vehicles Using Multiple Horizontal Laser Scanners

Applying Extended Object Tracking for Self-Localization of Roadside Radar Sensors

Detection of Road Traffic Participants Using Cost-Effective Arrayed Ultrasonic Sensors in Low-Speed Traffic Situations

Tracking as A Whole: Multi-Target Tracking by Modeling Group Behavior with Sequential Detection

Multiple Moving Vehicles Tracking Algorithm with Attention Mechanism and Motion Model

Multi-Object Tracking based on Imaging Radar 3D Object Detection

Vehicle tracking for an evasive manoeuvres assistant using low-cost ultrasonic sensors

Robust Target Detection and Tracking Algorithm Based on Roadside Radar and Camera

Tracking of Multiple Static and Dynamic Targets for 4D Automotive Millimeter-Wave Radar Point Cloud in Urban Environments

Target Recognition Around a Vehicle Based on an Ultrasonic Sensor Array