Abstract:Roadside perception is a key component in intelligent transportation systems. In this paper, we present a novel three-dimensional (3D) extended object tracking (EOT) method, which simultaneously estimates the object kinematics and extent state, in roadside perception using both the radar and camera data. Because of the influence of sensor viewing angle and limited angle resolution, radar measurements from objects are sparse and non-uniformly distributed, leading to inaccuracies in object extent and position estimation. To address this problem, we present a novel spherical Gaussian function weighted Gaussian mixture model. This model assumes that radar measurements originate from a series of probabilistic weighted radar reflectors on the vehicle's extent. Additionally, we utilize visual detection of vehicle keypoints to provide additional information on the positions of radar reflectors. Since keypoints may not always correspond to radar reflectors, we propose an elastic skeleton fusion mechanism, which constructs a virtual force to establish the relationship between the radar reflectors on the vehicle and its extent. Furthermore, to better describe the kinematic state of the vehicle and constrain its extent state, we develop a new 3D constant turn rate and velocity motion model, considering the complex 3D motion of the vehicle relative to the roadside sensor. Finally, we apply variational Bayesian approximation to the intractable measurement update step to enable recursive Bayesian estimation of the object's state. Simulation results using the Carla simulator and experimental results on the nuScenes dataset demonstrate the effectiveness and superiority of the proposed method in comparison to several state-of-the-art 3D EOT methods.

Single Camera Visual Odometry Based on Random Finite Set Statistics

Visual Odometry Based on Random Finite Set Statistics in Urban Environment.

Visual Odometry Based on a Bernoulli Filter

Multiple Vehicle Cooperative Localization under Random Finite Set Framework

Robust and Efficient Vehicles Motion Estimation with Low-Cost Multi-Camera and Odometer-Gyroscope

Single-Camera and Inter-Camera Vehicle Tracking and 3D Speed Estimation Based on Fusion of Visual and Semantic Features

Multiple vehicle cooperative localization with spatial registration based on a probability hypothesis density filter.

Visual Odometry in dynamical scenes

A Lane Marking Extraction Approach Based on Random Finite Set Statistics

Vehicle Trajectory Estimation Based on Fusion of Visual Motion Features and Deep Learning

A Robust Method for Ego-Motion Estimation in Urban Environment Using Stereo Camera

A ROBUST METHOD FOR STEREO VISUAL ODOMETRY BASED ON MULTIPLE EUCLIDEAN DISTANCE CONSTRAINT AND RANSAC ALGORITHM

Robust visual odometry for complex urban environments

Forward And Backward Visual Fusion Approach To Motion Estimation With High Robustness And Low Cost

Dynamic Vehicle Pose Estimation and Tracking Based on Motion Feedback for LiDARs

Motion Estimation Using Region-Level Segmentation and Extended Kalman Filter for Autonomous Driving

ACCURATE VEHICLE SPEED ESTIMATION FROM MONOCULAR CAMERA FOOTAGE

Classification of Random Moving Vehicles Using Images from Fixed Video Camera

3D Extended Object Tracking by Fusing Roadside Sparse Radar Point Clouds and Pixel Keypoints

A Stereo Visual Odometry Based on SURF Feature and Three Consecutive Frames

Enhanced Vehicle Movement Counting at Intersections via a Self-Learning Fisheye Camera System