Abstract:LiDAR-camera calibration is a precondition for many multi-sensor systems that fuse data from LiDAR and camera. However, the constraint from common field of view and the requirement for time synchronization make the calibration a challenging problem. In this paper, we propose a novel LiDAR-camera calibration method aiming to eliminate these two constraints. Specifically, we capture a scan of 3-D LiDAR when both the environment and the sensors are stationary, then move the camera to reconstruct the 3-D environment using the sequentially obtained images. Finally, we align 3-D visual points to the laser scan based on a tightly couple graph optimization method to calculate the extrinsic parameter between LiDAR and camera. Under this design, the configuration of these two sensors is free from the common field-of-view constraint due to the extended view from the moving camera. In addition, we also eliminate the requirement for time synchronization as we only use the single scan of laser data when the sensors are stationary. We theoretically derive the conditions of minimal observability for our method and prove that the accuracy of calibration is improved by collecting more observations from multiple scattered calibration targets. In addition, the proposed method is beneficial to not only plane measurement error-based calibration targets, such as chessboards, but also other point measurement error-based calibration targets, such as boxes and polygonal boards. We validate our method on both simulation and real-world data sets. Experiments show that our method achieves higher accuracy than other comparable methods, which is in accordance with our theoretical analysis.

Free and Global Pose Calibration of a Rotating Laser Monocular Vision Sensor for Robotic 3D Measurement System

Free Pose Calibration of a Line Laser Monocular Vision Sensor

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Multiconstraint Spatial and Temporal Calibration of Rotating Line Structured Light Vision Sensor

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Flexible On-Orbit Calibration for Monocular Camera and Laser Rangefinder Integrated Pose Measurement System

Calibrating and Correcting Pose of Monocular Vision and Laser Ranging Location System

Independent Pose Measurement Using Monocular Vision Based on Laser Projection

Method of Robot Calibration Based on Monocular Vision

Pose Measurement and Motion Estimation of Space Non-Cooperative Targets Based on Laser Radar and Stereo-Vision Fusion

Accurate Relative Measurement of Multitarget Poses by Monocular Vision for Nonmodel-Based Real-Time Calibration of Industrial Robot

A Global Calibration Method for Multi-Sensor Vision System

On-Orbit Autonomous Orientation of Multi-Camera Vision Measurement System

Hand-eye calibration method with a three-dimensional-vision sensor considering the rotation parameters of the robot pose

Accurate Calibration Methods for Multiply Monocular Vision Based Laser-line Rotating 3D Scanning

Global Calibration of Multi-sensor Vision System Based on Two Planar Targets

Simultaneous calibration for the structured light intrinsic parameters and hand-eye relation of robot

A Method for Hand-Eye Calibration of a Robot Vision Measuring System.

Vision-Based Method Of Kinematic Calibration And Image Tracking Of Position And Posture For 3-Rps Parallel Robot

Joint Spatial-Temporal Calibration for Camera and Global Pose Sensor

Calibration technology for robotic laser scanning system