Abstract:With the rapid development of autonomous driving and SLAM technology, the perception system of a vehicle heavily relies on laser and image sensors to capture the real-world scenario and avoid obstacles autonomously. To achieve accurate and robust multi-sensor fusion computation, high-precision extrinsic calibration of camera and laser scanner is a necessary requirement. Traditional multi-sensor calibration methods based on manual features rely on specific scenarios and may not provide feature information over long distances. In this paper, we present a novel approach for robustly calibrating the extrinsic parameters of a solid-state(SS) lidar-camera system in a natural environment. Our proposed method begins with obtaining robust line feature information. we first innovatively employ a super-voxel clustering method to extract global 3D line features from the complete point cloud and then back-project these 3D line features into 2D space. Afterward, a transformer-based edge detection network, EDTER, is used to detect the edge features and estimate the probability pixel-by-pixel. To consider the uncertainty of two-dimensional line features and the inconsistency of residuals at different distances, we construct a line feature weight model for line feature residual calculation. Finally, we minimize the residual errors using least squares optimization to recover the relative pose of the camera and the lidar sensor. We conducted a performance study to compare our proposed method against existing targetless calibration methods on various natural scenarios. The experimental results demonstrate that our proposed method achieves higher robustness, accuracy, and consistency, making it suitable for real-world applications.

Accurate Extrinsic Calibration Between Monocular Camera And Sparse 3d Lidar Points Without Markers

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

Extrinsic Calibration of A 3d Lidar and A Camera Using A Trihedron

3d Lidar-Camera Extrinsic Calibration Using An Arbitrary Trihedron

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

A Long-focus Camera and Telemetry LiDAR Calibration for Rapid Transit Equipment.

Spatiotemporal Decoupling Based LiDAR-Camera Calibration under Arbitrary Configurations.

Observability-Aware Intrinsic and Extrinsic Calibration of LiDAR-IMU Systems

Unsupervised Extrinsic Parameters Calibration for Multi-beam LIDARs

Extrinsic Calibration for Multi-Lidar Systems Involving Heterogeneous Laser Scanning Models.

Automatic Extrinsic Calibration of 3D LIDAR and Multi-Cameras Based on Graph Optimization

YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems

Targetless External Reference Calibration of LiDAR and Camera in Autonomous Driving Environment

Targetless Extrinsic Calibration of Camera and LiDAR via Identifying True 2-D–3-D Line Matching Among Unknown Line Correspondences of Structured Environments

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

Efficient Extrinsic Calibration of Multi-Sensor 3D LiDAR Systems for Autonomous Vehicles using Static Objects Information

A Target-based Calibration Method for LiDAR-Visual-Thermal Multi-Sensor System.

Line-based Automatic Extrinsic Calibration of LiDAR and Camera

Robust Calibration of Vehicle Solid-State Lidar-Camera Perception System Using Line-Weighted Correspondences in Natural Environments

Multi-Dimensional Geometric Feature-Based Calibration Method for LiDAR and Camera Fusion.