Abstract:LiDAR-camera calibration is a precondition for many multi-sensor systems that fuse data from LiDAR and camera. However, the constraint from common field of view and the requirement for time synchronization make the calibration a challenging problem. In this paper, we propose a novel LiDAR-camera calibration method aiming to eliminate these two constraints. Specifically, we capture a scan of 3-D LiDAR when both the environment and the sensors are stationary, then move the camera to reconstruct the 3-D environment using the sequentially obtained images. Finally, we align 3-D visual points to the laser scan based on a tightly couple graph optimization method to calculate the extrinsic parameter between LiDAR and camera. Under this design, the configuration of these two sensors is free from the common field-of-view constraint due to the extended view from the moving camera. In addition, we also eliminate the requirement for time synchronization as we only use the single scan of laser data when the sensors are stationary. We theoretically derive the conditions of minimal observability for our method and prove that the accuracy of calibration is improved by collecting more observations from multiple scattered calibration targets. In addition, the proposed method is beneficial to not only plane measurement error-based calibration targets, such as chessboards, but also other point measurement error-based calibration targets, such as boxes and polygonal boards. We validate our method on both simulation and real-world data sets. Experiments show that our method achieves higher accuracy than other comparable methods, which is in accordance with our theoretical analysis.

Calibration Method of Light-Field Camera for Photogrammetry Application

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Calibration of a Camera-Array-based Microscopic System with Spatiotemporal Structured Light Encoding

Mobile Camera Array Calibration for Light Field Acquisition

Extrinsic Calibration of a Single-Point Laser Rangefinder and Single Camera

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

Calibration of a Single-Point Laser Range Finder and a Camera

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

Simulation Of Imaging And Refocusing For Light Field Photography

Calibration and Auto-Refinement for Light Field Cameras

Automatic Geometrical Calibration for Multiprojector-Type Light Field Three-Dimensional Display

Research on depth measurement calibration of light field camera based on Gaussian fitting

Light field camera calibration and point spread function calculation based on differentiable ray tracing

LiFCal: Online Light Field Camera Calibration via Bundle Adjustment

Common Self-Polar Triangle of Separate Circles for Light Field Camera Calibration

Close-range Photogrammetry with Light Field Camera: from Disparity Map to Absolute Distance.

A Two-Step Calibration Method for Vision Measurement with Large Field of View

Novel method for structured light plane calibration in three-dimensional vision measurement

An on-line calibration method for camera with large FOV based on prior information

A Calibration Method for a Self-Rotating, Linear-Structured-Light Scanning, Three-Dimensional Reconstruction System Based on Plane Constraints

Calibration method for multi-focus microscopic 3D imaging system