Abstract:Roadside perception is a key component in intelligent transportation systems. In this paper, we present a novel three-dimensional (3D) extended object tracking (EOT) method, which simultaneously estimates the object kinematics and extent state, in roadside perception using both the radar and camera data. Because of the influence of sensor viewing angle and limited angle resolution, radar measurements from objects are sparse and non-uniformly distributed, leading to inaccuracies in object extent and position estimation. To address this problem, we present a novel spherical Gaussian function weighted Gaussian mixture model. This model assumes that radar measurements originate from a series of probabilistic weighted radar reflectors on the vehicle's extent. Additionally, we utilize visual detection of vehicle keypoints to provide additional information on the positions of radar reflectors. Since keypoints may not always correspond to radar reflectors, we propose an elastic skeleton fusion mechanism, which constructs a virtual force to establish the relationship between the radar reflectors on the vehicle and its extent. Furthermore, to better describe the kinematic state of the vehicle and constrain its extent state, we develop a new 3D constant turn rate and velocity motion model, considering the complex 3D motion of the vehicle relative to the roadside sensor. Finally, we apply variational Bayesian approximation to the intractable measurement update step to enable recursive Bayesian estimation of the object's state. Simulation results using the Carla simulator and experimental results on the nuScenes dataset demonstrate the effectiveness and superiority of the proposed method in comparison to several state-of-the-art 3D EOT methods.

A Method by Improved Circular Projection Matching of Tracking Twisty Road from Remote Sensi ng I magery

Road Detection from Optical Remote Sensing Imagery Using Circular Projection Matching and Tracking Strategy

Improved Mean Shift Algorithm and Its Application

A Reinforced Road Detection Method in Complicated Environment

Integrating Visual and Range Data for Road Detection.

Semi-automatic road tracking by template matching and distance transformation in urban areas

Road Extraction from High-Resolution Remote Sensing Images Based on an Improved Level Set Method

Research of Road Extraction Based on Hough Transformation and Morphology

Accurate urban road centerline extraction from VHR imagery via multiscale segmentation and tensor voting

Road Extraction from Remote Sensing Images Based on Line Detection

Road Centreline Extraction of High-Resolution Remote Sensing Image with Improved Beamlet Transform and K-Means Clustering

An Expert System for Road Extraction from Remote Sensing Image

A New Approach To Urban Road Extraction Using High-Resolution Aerial Image

Road Extraction from Remote Sensing Image Based on Multi-resolution Analysis

A new two-step road extraction method in high resolution remote sensing images

&Lt;title>road Extraction in Remote Sensing Images Based on PCNN and Mathematical Morphology</title>

Multi-Object Tracking Based on Improved Mean-Shift Algorithm

Road Extraction from Multi-source Remote Sensing Images Based on 2nd Generation Curvelet Fusion

Structural Road Identification and Tracking Algorithm Based on Maximum Correlation Criterion Image Segmentation

3D Extended Object Tracking by Fusing Roadside Sparse Radar Point Clouds and Pixel Keypoints

Road Extraction Base on Zernike Algorithm on SAR Image