Abstract:LiDAR-camera calibration is a precondition for many multi-sensor systems that fuse data from LiDAR and camera. However, the constraint from common field of view and the requirement for time synchronization make the calibration a challenging problem. In this paper, we propose a novel LiDAR-camera calibration method aiming to eliminate these two constraints. Specifically, we capture a scan of 3-D LiDAR when both the environment and the sensors are stationary, then move the camera to reconstruct the 3-D environment using the sequentially obtained images. Finally, we align 3-D visual points to the laser scan based on a tightly couple graph optimization method to calculate the extrinsic parameter between LiDAR and camera. Under this design, the configuration of these two sensors is free from the common field-of-view constraint due to the extended view from the moving camera. In addition, we also eliminate the requirement for time synchronization as we only use the single scan of laser data when the sensors are stationary. We theoretically derive the conditions of minimal observability for our method and prove that the accuracy of calibration is improved by collecting more observations from multiple scattered calibration targets. In addition, the proposed method is beneficial to not only plane measurement error-based calibration targets, such as chessboards, but also other point measurement error-based calibration targets, such as boxes and polygonal boards. We validate our method on both simulation and real-world data sets. Experiments show that our method achieves higher accuracy than other comparable methods, which is in accordance with our theoretical analysis.

A Method of Camera Calibration Using Geometrical Invariability of Line

Camera Calibration Technique Based on Virtual 3D Object

Camera lens radial distortion correction using two-view projective invariants.

Calibration of Fisheye Cameras Based on the Viewing Sphere

Centra Catadioptric Camera Calibration with Single Image.

Partition-Based Camera Intrinsic and Extrinsic Parameters Calibration for Planar Visual Metrology

Planar Visual Metrology Using Partition-Based Camera Calibration

Unified Optical Distortion Correction Method for Imaging Systems Using A Concise Geometrical Transformation Model

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Using Concurrent Lines in Central Catadioptric Camera Calibration

Catadioptric Camera Calibration Using Geometric Invariants

A High-Quality and Convenient Camera Calibration Method Using a Single Image

Geometry-Based Camera Calibration Using Closed-Form Solution of Principal Line

Camera Self-Calibration from Multi-View Images

How to turn your camera into a perfect pinhole model

A Novel Camera Calibration Method Based on Multiple Calibration Planes

Camera Self-Calibration: Geometry and Algorithms

Virtual Camera Based a Novel Calibration Without Modeling

A New Method of Calibrating the Camera Nonlinear Model

Linear Approaches to Camera Calibration from Sphere Images or Active Intrinsic Calibration Using Vanishing Points

Geometric Calibration for Cameras with Inconsistent Imaging Capabilities