Abstract:In a multi-sensor fusion system composed of cameras and LiDAR, precise extrinsic calibration contributes to the system's long-term stability and accurate perception of the environment. However, methods based on extracting and registering corresponding points still face challenges in terms of automation and precision. This paper proposes a novel fully automatic extrinsic calibration method for LiDAR-camera systems that circumvents the need for corresponding point registration. In our approach, a novel algorithm to extract required LiDAR correspondence point is proposed. This method can effectively filter out irrelevant points by computing the orientation of plane point clouds and extracting points by applying distance- and density-based thresholds. We avoid the need for corresponding point registration by introducing extrinsic parameters between the LiDAR and camera into the projection of extracted points and constructing co-planar constraints. These parameters are then optimized to solve for the extrinsic. We validated our method across multiple sets of LiDAR-camera systems. In synthetic experiments, our method demonstrates superior performance compared to current calibration techniques. Real-world data experiments further confirm the precision and robustness of the proposed algorithm, with average rotation and translation calibration errors between LiDAR and camera of less than 0.05 degree and 0.015m, respectively. This method enables automatic and accurate extrinsic calibration in a single one step, emphasizing the potential of calibration algorithms beyond using corresponding point registration to enhance the automation and precision of LiDAR-camera system calibration.

Zero-training LiDAR-Camera Extrinsic Calibration Method Using Segment Anything Model

Calib-Anything: Zero-training LiDAR-Camera Extrinsic Calibration Method Using Segment Anything

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

A Generic LiDAR-Camera Extrinsic Calibration Method base on Lightweight SAM

A Long-focus Camera and Telemetry LiDAR Calibration for Rapid Transit Equipment.

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Targetless Calibration of LiDAR-IMU System Based on Continuous-time Batch Estimation

A Review of Deep Learning-Based LiDAR and Camera Extrinsic Calibration

A Target-based Calibration Method for LiDAR-Visual-Thermal Multi-Sensor System.

Online,Target-Free LiDAR-Camera Extrinsic Calibration via Cross-Modal Mask Matching

Automatic targetless LiDAR–camera calibration: a survey

Line-based Automatic Extrinsic Calibration of LiDAR and Camera

Pixel-Level Extrinsic Self Calibration of High Resolution LiDAR and Camera in Targetless Environments

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

RobustCalib: Robust Lidar-Camera Extrinsic Calibration with Consistency Learning

Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups

SemCal: Semantic LiDAR-Camera Calibration using Neural MutualInformation Estimator

End-to-end Automatic Targetless Calibration Between Low-resolution LiDARs and Cameras Based on Cross-modal Attention

Multi-Dimensional Geometric Feature-Based Calibration Method for LiDAR and Camera Fusion.

LCCNet: LiDAR and Camera Self-Calibration using Cost Volume Network

YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems