Abstract:LiDAR-binocular camera systems have attracted increasing research attention with their advantages of two sensors. The two-sensor data fusion premise accurately calibrates the external parameters of both sensors. However, existing LiDAR and binocular camera calibration uses geometric methods to calibrate the left and right cameras with the LiDAR or register the LiDAR point cloud and camera depth map to obtain the extrinsic parameters. Existing methods have difficulty obtaining low binocular camera baseline length and reprojection errors simultaneously. This article proposes a binocular camera and LiDAR extrinsic parameter calibration method based on a back propagation (BP) neural network and checkerboard. First, a LiDAR-binocular camera calibration model is established, and the extrinsic parameters and intermediate variables to be calibrated are determined. The calibration rotation matrix has multiple variables that are not independent of each other, creating a complex model. The nine rotation matrix variables are decoupled and reduced using the Euler angle representation. Then, the BP neural network structure is determined using the external parameter calibration data characteristics. The calibration algorithm accuracy is improved by introducing the baseline and reprojection errors into the loss function. Finally, we use real data to check the calibration performance and introduce the baseline length and reprojection errors as indicators to improve the calibration result evaluation accuracy and effectiveness. The results show that the proposed calibration method has good consistency and small baseline and reprojection errors. Compared with traditional perspective-n-point (PnP) methods, the average baseline error is reduced by 64.804%, and the reprojection error is reduced by approximately 10%.

Binocular Vision Calibration and 3D Re-Construction with an Orthogonal Learning Neural Network.

Binocular vision calibration and 3D re-construction with an orthogonal learning neural network

Stereo Calibration and Rectification for Omnidirectional Multi-Camera Systems

A Hybrid Calibration Method for the Binocular Omnidirectional Vision System

Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

3D Reconstruction Approach Based on Neural Network

High Precision Calibration Algorithm for Binocular Stereo Vision Camera using Deep Reinforcement Learning

High-Precision Measurement of Binocular Telecentric Vision System With Novel Calibration and Matching Methods

Extrinsic Calibration of a Binocular Camera and LiDAR Based on Neural Networks

Precise Calibration Of Binocular Vision System Used For Vision Measurement

Precise Calibration of Binocular Vision System Used for Vision Measurement.

Genetic Optimized Bp Network Method for Camera Calibration in Binocular Vision

Precision Calibration Method for Binocular Vision Measurement Systems Based on Arbitrary Translations and 3D-Connection Information

Calibration on Camera’s Intrinsic Parameters Based on Orthogonal Learning Neural Network and Vanishing Points

Three-dimensional Spatial Localization Based on Binocular Vsion

A Novel Approach To Calibrating Multifunctional Binocular Stereovision Sensor

A calibration method for binocular vision based on image processing

Vanishing feature constraints calibration method for binocular vision sensor.

Camera Calibration of Binocular Vision System Based on BP Neural Network

Design of Binocular Stereo Vision System with Parallel Optical Axesand Image 3D Reconstruction

A Calibration Method for Structured Light 3-D Vision Systems