Abstract:Determining the extrinsic parameter between multiple LiDARs and cameras is essential for autonomous robots, especially for solid-state LiDARs, where each LiDAR unit has a very small Field-of-View (FoV), and multiple units are often used collectively. The majority of extrinsic calibration methods are proposed for 360$^\circ$ mechanical spinning LiDARs where the FoV overlap with other LiDAR or camera sensors is assumed. Few research works have been focused on the calibration of small FoV LiDARs and cameras nor on the improvement of the calibration speed. In this work, we consider the problem of extrinsic calibration among small FoV LiDARs and cameras, with the aim to shorten the total calibration time and further improve the calibration precision. We first implement an adaptive voxelization technique in the extraction and matching of LiDAR feature points. Such a process could avoid the redundant creation of $k$-d trees in LiDAR extrinsic calibration and extract LiDAR feature points in a more reliable and fast manner than existing methods. We then formulate the multiple LiDAR extrinsic calibration into a LiDAR Bundle Adjustment (BA) problem. By deriving the cost function up to second-order, the solving time and precision of the non-linear least square problem are further boosted. Our proposed method has been verified on data collected in four targetless scenes and under two types of solid-state LiDARs with a completely different scanning pattern, density, and FoV. The robustness of our work has also been validated under eight initial setups, with each setup containing 100 independent trials. Compared with the state-of-the-art methods, our work has increased the calibration speed 15 times for LiDAR-LiDAR extrinsic calibration and 1.5 times for LiDAR-Camera extrinsic calibration (averaged result from 50 independent trials) while remaining accurate.

A Generic LiDAR-Camera Extrinsic Calibration Method base on Lightweight SAM

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

A Long-focus Camera and Telemetry LiDAR Calibration for Rapid Transit Equipment.

Targetless Calibration of LiDAR-IMU System Based on Continuous-time Batch Estimation

Calib-Anything: Zero-training LiDAR-Camera Extrinsic Calibration Method Using Segment Anything

Spatiotemporal Decoupling Based LiDAR-Camera Calibration under Arbitrary Configurations.

Zero-training LiDAR-Camera Extrinsic Calibration Method Using Segment Anything Model

A Target-based Calibration Method for LiDAR-Visual-Thermal Multi-Sensor System.

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

A Review of Deep Learning-Based LiDAR and Camera Extrinsic Calibration

Extrinsic Calibration for Multi-Lidar Systems Involving Heterogeneous Laser Scanning Models.

LiDAR and Camera External Parameter Calibration Method Based on Multi-Dimensional Dynamic Convolution

Automatic targetless LiDAR–camera calibration: a survey

CPI: LiDAR-Camera Extrinsic Calibration Based on Feature Points with Reflection Intensity

Multi-Dimensional Geometric Feature-Based Calibration Method for LiDAR and Camera Fusion.

Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups

YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems

Targetless Extrinsic Calibration of Multiple Small FoV LiDARs and Cameras using Adaptive Voxelization

Automated Extrinsic Calibration of Multi-cameras and LiDAR

Targetless External Reference Calibration of LiDAR and Camera in Autonomous Driving Environment