Abstract:LiDAR-camera calibration is a precondition for many multi-sensor systems that fuse data from LiDAR and camera. However, the constraint from common field of view and the requirement for time synchronization make the calibration a challenging problem. In this paper, we propose a novel LiDAR-camera calibration method aiming to eliminate these two constraints. Specifically, we capture a scan of 3-D LiDAR when both the environment and the sensors are stationary, then move the camera to reconstruct the 3-D environment using the sequentially obtained images. Finally, we align 3-D visual points to the laser scan based on a tightly couple graph optimization method to calculate the extrinsic parameter between LiDAR and camera. Under this design, the configuration of these two sensors is free from the common field-of-view constraint due to the extended view from the moving camera. In addition, we also eliminate the requirement for time synchronization as we only use the single scan of laser data when the sensors are stationary. We theoretically derive the conditions of minimal observability for our method and prove that the accuracy of calibration is improved by collecting more observations from multiple scattered calibration targets. In addition, the proposed method is beneficial to not only plane measurement error-based calibration targets, such as chessboards, but also other point measurement error-based calibration targets, such as boxes and polygonal boards. We validate our method on both simulation and real-world data sets. Experiments show that our method achieves higher accuracy than other comparable methods, which is in accordance with our theoretical analysis.

Partition-Based Camera Intrinsic and Extrinsic Parameters Calibration for Planar Visual Metrology

Planar Visual Metrology Using Partition-Based Camera Calibration

Camera Calibration Technique Based on Virtual 3D Object

Partition-Based Planar Image Dynamic Measurement For Position Control Of 2dof Pneumatic Robot

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Extrinsic Calibration of A 3d Lidar and A Camera Using A Trihedron

3d Lidar-Camera Extrinsic Calibration Using An Arbitrary Trihedron

Extrinsic Calibration of a Single-Point Laser Rangefinder and Single Camera

A Novel Camera Calibration Method Based on Multiple Calibration Planes

Extrinsic Parameter Calibration Method for a Visual/Inertial Integrated System with a Predefined Mechanical Interface

An extrinsic calibration method for binocular cameras and swing 2D laser rangefinder

Effective camera calibration in free-viewpoint systems

Joint Camera Intrinsic and LiDAR-Camera Extrinsic Calibration

Efficient and robust camera extrinsic parameters calibration algorithm

A New Method of Calibrating the Camera Nonlinear Model

Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

A Target-based Calibration Method for LiDAR-Visual-Thermal Multi-Sensor System.

Calibrating Method of Camera in Opto-Electronic System

A planar constraint optimization method to improve camera calibration for imperfect planar targets

DoF-Dependent and Equal-Partition Based Lens Distortion Modeling and Calibration Method for Close-Range Photogrammetry