Abstract:With the rapid development of autonomous driving and SLAM technology, the perception system of a vehicle heavily relies on laser and image sensors to capture the real-world scenario and avoid obstacles autonomously. To achieve accurate and robust multi-sensor fusion computation, high-precision extrinsic calibration of camera and laser scanner is a necessary requirement. Traditional multi-sensor calibration methods based on manual features rely on specific scenarios and may not provide feature information over long distances. In this paper, we present a novel approach for robustly calibrating the extrinsic parameters of a solid-state(SS) lidar-camera system in a natural environment. Our proposed method begins with obtaining robust line feature information. we first innovatively employ a super-voxel clustering method to extract global 3D line features from the complete point cloud and then back-project these 3D line features into 2D space. Afterward, a transformer-based edge detection network, EDTER, is used to detect the edge features and estimate the probability pixel-by-pixel. To consider the uncertainty of two-dimensional line features and the inconsistency of residuals at different distances, we construct a line feature weight model for line feature residual calculation. Finally, we minimize the residual errors using least squares optimization to recover the relative pose of the camera and the lidar sensor. We conducted a performance study to compare our proposed method against existing targetless calibration methods on various natural scenarios. The experimental results demonstrate that our proposed method achieves higher robustness, accuracy, and consistency, making it suitable for real-world applications.

Pairwise LIDAR Calibration Using Multi-Type 3D Geometric Features in Natural Scene.

Calibration Method for Multiple 2D LIDARs System

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

A Long-focus Camera and Telemetry LiDAR Calibration for Rapid Transit Equipment.

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Spatiotemporal Decoupling Based LiDAR-Camera Calibration under Arbitrary Configurations.

Unsupervised Extrinsic Parameters Calibration for Multi-beam LIDARs

Extrinsic Calibration of A 3d Lidar and A Camera Using A Trihedron

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

A Target-based Calibration Method for LiDAR-Visual-Thermal Multi-Sensor System.

Automatic Multi-LiDAR Calibration and Refinement Method

Multi-Dimensional Geometric Feature-Based Calibration Method for LiDAR and Camera Fusion.

Automatic Multi-camera Multi-LiDAR Extrinsic Calibration Using Geometric Corners.

Efficient Extrinsic Calibration of Multi-Sensor 3D LiDAR Systems for Autonomous Vehicles using Static Objects Information

Extrinsic Calibration for Multi-Lidar Systems Involving Heterogeneous Laser Scanning Models.

Extrinsic Calibration of the 2-D LiDARs Based on the Attitude Information of the Mobile Platform and a Fixed Plane

Target-based calibration of 3D LiDAR and binocular camera on unmanned vehicles

Coarse-to-fine Hybrid 3D Mapping System with Co-calibrated Omnidirectional Camera and Non-repetitive LiDAR

Automatic Extrinsic Calibration of 3D LIDAR and Multi-Cameras Based on Graph Optimization

Robust Calibration of Vehicle Solid-State Lidar-Camera Perception System Using Line-Weighted Correspondences in Natural Environments