Abstract:In a multi-sensor fusion system composed of cameras and LiDAR, precise extrinsic calibration contributes to the system's long-term stability and accurate perception of the environment. However, methods based on extracting and registering corresponding points still face challenges in terms of automation and precision. This paper proposes a novel fully automatic extrinsic calibration method for LiDAR-camera systems that circumvents the need for corresponding point registration. In our approach, a novel algorithm to extract required LiDAR correspondence point is proposed. This method can effectively filter out irrelevant points by computing the orientation of plane point clouds and extracting points by applying distance- and density-based thresholds. We avoid the need for corresponding point registration by introducing extrinsic parameters between the LiDAR and camera into the projection of extracted points and constructing co-planar constraints. These parameters are then optimized to solve for the extrinsic. We validated our method across multiple sets of LiDAR-camera systems. In synthetic experiments, our method demonstrates superior performance compared to current calibration techniques. Real-world data experiments further confirm the precision and robustness of the proposed algorithm, with average rotation and translation calibration errors between LiDAR and camera of less than 0.05 degree and 0.015m, respectively. This method enables automatic and accurate extrinsic calibration in a single one step, emphasizing the potential of calibration algorithms beyond using corresponding point registration to enhance the automation and precision of LiDAR-camera system calibration.

Automatic Targetless Extrinsic Calibration Between a Spinning Actuated LiDAR and a Camera

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

A Long-focus Camera and Telemetry LiDAR Calibration for Rapid Transit Equipment.

Spatiotemporal Decoupling Based LiDAR-Camera Calibration under Arbitrary Configurations.

Targetless Calibration of LiDAR-IMU System Based on Continuous-time Batch Estimation

Observability-Aware Intrinsic and Extrinsic Calibration of LiDAR-IMU Systems

An Efﬁcient LiDAR-IMU Calibration Method Based on Continuous-Time Trajectory

A Target-based Calibration Method for LiDAR-Visual-Thermal Multi-Sensor System.

Automatic targetless LiDAR–camera calibration: a survey

YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems

Adaptive Point-Line Fusion: A Targetless LiDAR–Camera Calibration Method with Scheme Selection for Autonomous Driving

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

Targetless External Reference Calibration of LiDAR and Camera in Autonomous Driving Environment

Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups

Joint Camera Intrinsic and LiDAR-Camera Extrinsic Calibration

CPI: LiDAR-Camera Extrinsic Calibration Based on Feature Points with Reflection Intensity

Automated Extrinsic Calibration of Multi-cameras and LiDAR

Extrinsic Calibration for Multi-Lidar Systems Involving Heterogeneous Laser Scanning Models.

LCE-Calib: Automatic LiDAR-Frame/Event Camera Extrinsic Calibration With A Globally Optimal Solution

Online Calibration Between Camera and LiDAR With Spatial-Temporal Photometric Consistency