Abstract:LiDAR-camera calibration is a precondition for many multi-sensor systems that fuse data from LiDAR and camera. However, the constraint from common field of view and the requirement for time synchronization make the calibration a challenging problem. In this paper, we propose a novel LiDAR-camera calibration method aiming to eliminate these two constraints. Specifically, we capture a scan of 3-D LiDAR when both the environment and the sensors are stationary, then move the camera to reconstruct the 3-D environment using the sequentially obtained images. Finally, we align 3-D visual points to the laser scan based on a tightly couple graph optimization method to calculate the extrinsic parameter between LiDAR and camera. Under this design, the configuration of these two sensors is free from the common field-of-view constraint due to the extended view from the moving camera. In addition, we also eliminate the requirement for time synchronization as we only use the single scan of laser data when the sensors are stationary. We theoretically derive the conditions of minimal observability for our method and prove that the accuracy of calibration is improved by collecting more observations from multiple scattered calibration targets. In addition, the proposed method is beneficial to not only plane measurement error-based calibration targets, such as chessboards, but also other point measurement error-based calibration targets, such as boxes and polygonal boards. We validate our method on both simulation and real-world data sets. Experiments show that our method achieves higher accuracy than other comparable methods, which is in accordance with our theoretical analysis.

Revisiting Principal-Axes Aligned Conies: A Unified Algebraic Constraint and Geometric Interpretation for Camera Calibration

Camera Calibration Using Principal-Axes Aligned Conics

Camera Calibration Technique Based on Virtual 3D Object

Using Concurrent Lines in Central Catadioptric Camera Calibration

Centra Catadioptric Camera Calibration with Single Image.

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Stereo Calibration and Rectification for Omnidirectional Multi-Camera Systems

Unconstrained Self-Calibration of Stereo Camera on Visually Impaired Assistance Devices.

Full Camera Calibration from a Single View of Planar Scene

Linear Approaches to Camera Calibration from Sphere Images or Active Intrinsic Calibration Using Vanishing Points

Analysis of the Pencil of Conics with Double Complex Contact and Its Application to Camera Calibration

Camera Calibration with Enclosing Ellipses by an Extended Application of Generalized Eigenvalue Decomposition

A Linear Approach to Camera Calibration Using Concentric Circles

The Projective Equation Of A Circle And Its Application In Camera Calibration

A Stable, Efficient, and High-Precision Non-Coplanar Calibration Method: Applied for Multi-Camera-Based Stereo Vision Measurements

Geometry-Based Camera Calibration Using Closed-Form Solution of Principal Line

Using Coplanar Circles to Perform Calibration-Free Planar Scene Analysis under a Perspective View

Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

A Unifying Model for Camera Calibration

Effective camera calibration in free-viewpoint systems

Automatically Obtaining the Correspondences of Four Coplanar Points for an Uncalibrated Camera.