Abstract:LiDAR-camera calibration is a precondition for many multi-sensor systems that fuse data from LiDAR and camera. However, the constraint from common field of view and the requirement for time synchronization make the calibration a challenging problem. In this paper, we propose a novel LiDAR-camera calibration method aiming to eliminate these two constraints. Specifically, we capture a scan of 3-D LiDAR when both the environment and the sensors are stationary, then move the camera to reconstruct the 3-D environment using the sequentially obtained images. Finally, we align 3-D visual points to the laser scan based on a tightly couple graph optimization method to calculate the extrinsic parameter between LiDAR and camera. Under this design, the configuration of these two sensors is free from the common field-of-view constraint due to the extended view from the moving camera. In addition, we also eliminate the requirement for time synchronization as we only use the single scan of laser data when the sensors are stationary. We theoretically derive the conditions of minimal observability for our method and prove that the accuracy of calibration is improved by collecting more observations from multiple scattered calibration targets. In addition, the proposed method is beneficial to not only plane measurement error-based calibration targets, such as chessboards, but also other point measurement error-based calibration targets, such as boxes and polygonal boards. We validate our method on both simulation and real-world data sets. Experiments show that our method achieves higher accuracy than other comparable methods, which is in accordance with our theoretical analysis.

Data Processing Method of Time-of-flight 3D Imaging Camera

3D Framing Camera System Based on Sample Cumulation Method

Centroid Real-Time Measurement Method Based on Point Cloud Fusion

DoCam: Depth Sensing with an Optical Image Stabilization Supported RGB Camera.

Stereo Vision and Fourier Transform Profilometry for 3D Measurement

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Sensors for 3D Imaging: Metric Evaluation and Calibration of a CCD/CMOS Time-of-Flight Camera

On-the-fly Extrinsic Calibration of Multimodal Sensing System for Fast 3D Thermographic Scanning

Assessment and Improvement of Distance Measurement Accuracy for Time-of-Flight Cameras

All Pixels Calibration for ToF Camera

Depth Errors Analysis and Correction for Time-of-Flight (tof) Cameras.

A Learning Method To Optimize Depth Accuracy And Frame Rate For Time Of Flight Camera

Accurate 3D reconstruction using a multi-phase ToF camera

Improved Dual-Frequency On-Line Phase Measuring Profilometry Based On Full-Cycle Equal Phase-Shift Algorithm

Iterative Error Removal for Time-of-Flight Depth Imaging

High dynamic range 3D measurement based on polarization and multispectrum co-modulation

Three-dimensional coordinate measuring method based on single-camera two-color linear structured light

Evaluation and Compensation of the Effect of Dirt on Time-of-Flight 3D Imaging Systems

Optimization of Timepix3-based Conventional Compton Camera Using Electron Track Algorithm

Improvements of the 3D images captured with Time-of-Flight cameras

An Accurate and Stable Extrinsic Calibration for A Camera and A 1D Laser Range Finder