Abstract:To find the intrinsic parameters of a camera, a LiDAR data-based camera self-calibration method is presented here. Parameters have been estimated using particle swarm optimization (PSO), enhancing the optimal solution of a multivariate cost function. The main procedure of camera intrinsic parameter estimation has three parts, which include extraction and fine matching of interest points in the images, establishment of cost function, based on Kruppa equations and optimization of PSO using LiDAR data as the initialization input. To improve the precision of matching pairs, a new method of maximal information coefficient (MIC) and maximum asymmetry score (MAS) was used to remove false matching pairs based on the RANSAC algorithm. Highly precise matching pairs were used to calculate the fundamental matrix so that the new cost function (deduced from Kruppa equations in terms of the fundamental matrix) was more accurate. The cost function involving four intrinsic parameters was minimized by PSO for the optimal solution. To overcome the issue of optimization pushed to a local optimum, LiDAR data was used to determine the scope of initialization, based on the solution to the P4P problem for camera focal length. To verify the accuracy and robustness of the proposed method, simulations and experiments were implemented and compared with two typical methods. Simulation results indicated that the intrinsic parameters estimated by the proposed method had absolute errors less than 1.0 pixel and relative errors smaller than 0.01%. Based on ground truth obtained from a meter ruler, the distance inversion accuracy in the experiments was smaller than 1.0 cm. Experimental and simulated results demonstrated that the proposed method was highly accurate and robust.

Parameters Separated Calibration Based on Particle Swarm Optimization for A Camera and A Laser-Rangefinder Information Fusion

Separated Calibration of a Camera and a Laser Rangefinder for Robotic Heterogeneous Sensors

Extrinsic Calibration of a Single-Point Laser Rangefinder and Single Camera

A Long-focus Camera and Telemetry LiDAR Calibration for Rapid Transit Equipment.

Calibration of a Single-Point Laser Range Finder and a Camera

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

A Target-based Calibration Method for LiDAR-Visual-Thermal Multi-Sensor System.

The Extrinsic Calibration of Area-Scan Camera and 2D Laser Rangefinder (LRF) Using Checkerboard Trihedron

Extrinsic calibration and usage of a single-point laser rangefinder and single camera

A LiDAR Data-Based Camera Self-Calibration Method

A Novel and Simplified Extrinsic Calibration of 2D Laser Rangefinder and Depth Camera

Extrinsic Calibration between a Camera and a 2D Laser Rangefinder using a Photogrammetric Control Field

Fine Registration of Low-Resolution Infrared Camera and Low-Beam LiDAR

A Method for Synchronous Automated Extrinsic Calibration of LiDAR and Cameras Based on a Circular Calibration Board

An extrinsic calibration method for binocular cameras and swing 2D laser rangefinder

Extrinsic Calibration Between a Stereo System and a 3D LIDAR

An Accurate and Stable Extrinsic Calibration for A Camera and A 1D Laser Range Finder

Calibration of a 3D laser rangefinder and a camera based on optimization solution

Self-calibration of Heterogeneous Sensors Based on Particle Swarm Optimization

Calibration of Multi-Sensor Fusion for Autonomous Vehicle System

CPI: LiDAR-Camera Extrinsic Calibration Based on Feature Points with Reflection Intensity