Abstract:A vehicle micro-trajectory automatic acquisition method based on multisensor fusion is proposed to enhance the accuracy of trajectory sensed by traffic monitoring equipment while minimizing equipment expenditures. First, the YOLOv5 + DeepSORT vehicle recognition and tracking model is applied to obtain the video's pixel trajectories of moving vehicles. Second, calibrate the camera's internal parameters by calibration method with a checkerboard grid and obtain the conversion formula between pixel and camera coordinate system. Third, calibrate the camera's external parameters by matching the feature point information of the diffuse calibration plate both in light detection and ranging (LiDAR) and camera, and determine the positional relationship between the LiDAR and camera coordinate system. Then, to convert pixel trajectory to real trajectory, we construct the conversion formula from the pixel coordinate system to the LiDAR coordinate system by combining the internal and external parameters. Finally, the kernel regression method based on the Gaussian function reduces inaccuracies caused by camera vibration and coordinate transformation. Also, a trajectory fusion method based on Kalman filtering with dynamically assigned weight coefficients is proposed. It uses multiple cameras to collect data simultaneously and effectively fuse them to improve the trajectory integrity and continuity further while improving the accuracy and reliability of vehicle tracking. Experiments are conducted on three scenarios to validate the proposed method: a straight road section, a curving road section, and an intersection. The experimental results were compared with the vehicle trajectories retrieved from LiDAR data. The results indicate that the average absolute error of the optimized trajectory under monocular vision is reduced by about 40%, and the average absolute error of the velocity is re- uced by about 45% compared with that before the optimization. Compared with the real trajectory, the error of the calibrated trajectory is within 0.2 m. The fused trajectory under binocular vision can fill in more than 85% of the missing trajectory points. Compared with monocular vision, the average absolute error of the trajectory is reduced by more than 0.03 m, and the velocity error index is further improved. This method effectively improves the accuracy of acquiring vehicle trajectories through traffic monitoring videos.

Extraction and Calibration of Trajectory Characteristics of Vehicles at Intersections

Pedestrian movement trajectory reappearance and crossing feature expression based on video processing

A Long-focus Camera and Telemetry LiDAR Calibration for Rapid Transit Equipment.

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

Automatic Calibration and Association for Roadside Radar and Camera Based on Fluctuating Traffic Volume

Vehicle Micro-Trajectory Automatic Acquisition Method Based on Multisensor Fusion

Vehicle Trajectory Extraction at the Exit Areas of Urban Freeways Based on a Novel Composite Algorithms Framework

Cooperative Visual-LiDAR Extrinsic Calibration Technology for Intersection Vehicle-Infrastructure: A review

Multimodal Urban Remote Sensing Image Registration Via Roadcross Triangular Feature

High-Resolution Vehicle Trajectory Extraction and Denoising from Aerial Videos.

Trajectory analysis of moving objects at intersection based on laser-data

Vehicle Feature Point Trajectory Clustering and Vehicle Behavior Analysis in Complex Traffic Scenes.

Vehicle Localization in 3D World Coordinates Using Single Camera at Traffic Intersection

A Robust Traffic Parameter Extraction Approach for Surveillance System at Urban Intersection

A Novel Robust Method for Camera Auto-Calibration in Transportation Surveillance

Extraction of moving objects at an intersecton and application for safe driving using laser scannners

TrajMatch: Toward Automatic Spatio-Temporal Calibration for Roadside LiDARs Through Trajectory Matching

Arterial Traffic Flow Estimation Based on Vehicle-to-Cloud Vehicle Trajectory Data Considering Multi-Intersection Interaction and Coordination

Target Tracking and 3D Trajectory Reconstruction Based on Multicamera Calibration

Intersection Detection and Recognition for Autonomous Urban Driving Using a Virtual Cylindrical Scanner

Sensing an Intersection Using a Network of Laser Scanners and Video Cameras.