Abstract:Far-range perception through roadside sensors is crucial to the effectiveness of intelligent transportation systems. The main challenge of far-range perception is due to the difficulty of performing accurate object detection and tracking under far distances (e.g., > 150m) at a low cost. To cope with such challenges, deploying both millimeter wave Radars and high-definition (HD) cameras, and fusing their data for joint perception has become a common practice. The key to this solution, however, is the precise association between the two types of data, which are captured from different perspectives and have different degrees of measurement noises. Towards this goal, the first question is which plane to conduct the association, i.e., the 2D image plane or the BEV plane. We argue that the former is more suitable because the magnitude of location errors in the perspective projection points is smaller at far distances on the 2D plane and can lead to more accurate association. Thus, we first project the Radar-based target locations (on the BEV plane) to the 2D plane and then associate them with the camera-based object locations that are modeled as a point on each object. Subsequently, we map the camera-based object locations to the BEV plane through inverse projection mapping (IPM) with the corresponding depth information from the Radar data. Finally, we engage a BEV tracking module to generate target trajectories for traffic monitoring. Since our approach involves transformation between the 2D plane and BEV plane, we also devise a transformation parameters refining approach based on a depth scaling technique, utilising the above fusion process without requiring any additional devices such as GPS. We have deployed an actual testbed on an urban expressway and conducted extensive experiments to evaluate the effectiveness of our system. The results show that our system can improve AP BEV by 32%, and reduce the location error by 0.56m . Our system is capable of achieving an average location accuracy of 1.3m when we extend the detection range up to 500m . We thus believe that our proposed method offers a viable approach to efficient roadside far-range perception.

Extracting Vehicle Trajectories from Partially Overlapping Roadside Radar

Traffic Signal Phase and Timing Estimation Using Trajectory Data from Radar Vision Integrated Camera

Road-Map Aided GM-PHD Filter for Multivehicle Tracking With Automotive Radar

LiRaNet: End-to-End Trajectory Prediction using Spatio-Temporal Radar Fusion

Vehicle Trajectory Collection Using On-Board Multi-Lidars for Driving Behavior Analysis

High-Resolution Vehicle Trajectory Extraction and Denoising from Aerial Videos.

Deep Learning Techniques for Vehicle Trajectory Extraction in Mixed Traffic

Framework for Quantifying Right-Turn-on-Red Conflicts From Existing Radar-Based Vehicle Detection Infrastructure

RaDICaL: A Synchronized FMCW Radar, Depth, IMU and RGB Camera Data Dataset With Low-Level FMCW Radar Signals

Vehicle Re-Identification and Trajectory Reconstruction Using Multiple Moving Cameras in the CARLA Driving Simulator.

Automated Lane-Level Road Geometry Estimation Using Microscopic Trajectory Data

Vehicle trajectory reconstruction for freeway traffic considering lane changing behaviors

Radar Odometry Combining Probabilistic Estimation and Unsupervised Feature Learning

3D Extended Object Tracking by Fusing Roadside Sparse Radar Point Clouds and Pixel Keypoints

FARFusion: A Practical Roadside Radar-Camera Fusion System for Far-Range Perception

Automatic vehicle trajectory data reconstruction at scale

Sensor Fusion-Based Vehicle Detection and Tracking Using a Single Camera and Radar at a Traffic Intersection

Integrated macro-micro modelling for individual vehicle trajectory reconstruction using fixed and mobile sensor data

Massive Trajectory Matching and Construction from Aerial Videos based on Frame-by-Frame Vehicle Detections

Realtime wide-area vehicle trajectory tracking using millimeter-wave radar sensors and the open TJRD TS dataset

Raw High-Definition Radar for Multi-Task Learning