Abstract:In a multi-sensor fusion system composed of cameras and LiDAR, precise extrinsic calibration contributes to the system's long-term stability and accurate perception of the environment. However, methods based on extracting and registering corresponding points still face challenges in terms of automation and precision. This paper proposes a novel fully automatic extrinsic calibration method for LiDAR-camera systems that circumvents the need for corresponding point registration. In our approach, a novel algorithm to extract required LiDAR correspondence point is proposed. This method can effectively filter out irrelevant points by computing the orientation of plane point clouds and extracting points by applying distance- and density-based thresholds. We avoid the need for corresponding point registration by introducing extrinsic parameters between the LiDAR and camera into the projection of extracted points and constructing co-planar constraints. These parameters are then optimized to solve for the extrinsic. We validated our method across multiple sets of LiDAR-camera systems. In synthetic experiments, our method demonstrates superior performance compared to current calibration techniques. Real-world data experiments further confirm the precision and robustness of the proposed algorithm, with average rotation and translation calibration errors between LiDAR and camera of less than 0.05 degree and 0.015m, respectively. This method enables automatic and accurate extrinsic calibration in a single one step, emphasizing the potential of calibration algorithms beyond using corresponding point registration to enhance the automation and precision of LiDAR-camera system calibration.

A Long-focus Camera and Telemetry LiDAR Calibration for Rapid Transit Equipment.

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

An Efﬁcient LiDAR-IMU Calibration Method Based on Continuous-Time Trajectory

Observability-Aware Intrinsic and Extrinsic Calibration of LiDAR-IMU Systems

Targetless Calibration of LiDAR-IMU System Based on Continuous-time Batch Estimation

Spatiotemporal Decoupling Based LiDAR-Camera Calibration under Arbitrary Configurations.

A Target-based Calibration Method for LiDAR-Visual-Thermal Multi-Sensor System.

Multi-Dimensional Geometric Feature-Based Calibration Method for LiDAR and Camera Fusion.

Fine Registration of Low-Resolution Infrared Camera and Low-Beam LiDAR

Adaptive Point-Line Fusion: A Targetless LiDAR–Camera Calibration Method with Scheme Selection for Autonomous Driving

Automated Extrinsic Calibration of Multi-cameras and LiDAR

Line Feature Based Extrinsic Calibration of LiDAR and Camera

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

LiDAR and Camera External Parameter Calibration Method Based on Multi-Dimensional Dynamic Convolution

YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems

Automatic Extrinsic Calibration of 3D LIDAR and Multi-Cameras Based on Graph Optimization

A Review of Deep Learning-Based LiDAR and Camera Extrinsic Calibration

Targetless External Reference Calibration of LiDAR and Camera in Autonomous Driving Environment

Online Calibration Between Camera and LiDAR With Spatial-Temporal Photometric Consistency

3D LiDAR/IMU Calibration Based on Continuous-Time Trajectory Estimation in Structured Environments