Abstract:LiDAR-binocular camera systems have attracted increasing research attention with their advantages of two sensors. The two-sensor data fusion premise accurately calibrates the external parameters of both sensors. However, existing LiDAR and binocular camera calibration uses geometric methods to calibrate the left and right cameras with the LiDAR or register the LiDAR point cloud and camera depth map to obtain the extrinsic parameters. Existing methods have difficulty obtaining low binocular camera baseline length and reprojection errors simultaneously. This article proposes a binocular camera and LiDAR extrinsic parameter calibration method based on a back propagation (BP) neural network and checkerboard. First, a LiDAR-binocular camera calibration model is established, and the extrinsic parameters and intermediate variables to be calibrated are determined. The calibration rotation matrix has multiple variables that are not independent of each other, creating a complex model. The nine rotation matrix variables are decoupled and reduced using the Euler angle representation. Then, the BP neural network structure is determined using the external parameter calibration data characteristics. The calibration algorithm accuracy is improved by introducing the baseline and reprojection errors into the loss function. Finally, we use real data to check the calibration performance and introduce the baseline length and reprojection errors as indicators to improve the calibration result evaluation accuracy and effectiveness. The results show that the proposed calibration method has good consistency and small baseline and reprojection errors. Compared with traditional perspective-n-point (PnP) methods, the average baseline error is reduced by 64.804%, and the reprojection error is reduced by approximately 10%.

Genetic Optimized Bp Network Method for Camera Calibration in Binocular Vision

A Camera Calibration Method Based on Neural Network Optimized by Genetic Algorithm

Research on the Calibration of Binocular Camera Based on BP Neural Network Optimized by Improved Genetic Simulated Annealing Algorithm

Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

Camera Calibration of Binocular Vision System Based on BP Neural Network

Research of Camera Calibration Based on Genetic Algorithm BP Neural Network

An Optimization Based Vision Calibration Method for PTZ Camera's Errors in Model and Execution

Study on Camera Calibration for Binocular Vision Based on GEP

Camera Calibration by Hybrid Hopfield Network and Self- Adaptive Genetic Algorithm

A Hybrid Calibration Method for the Binocular Omnidirectional Vision System

Camera Calibration of Stereo Vision System Based on Genetic Algorithms

A Novel Camera Calibration Method for Binocular Vision Based on Improved RBF Neural Network

Camera Calibration in Computer Vision Based on Artificial Neural Network

Extrinsic Calibration of a Binocular Camera and LiDAR Based on Neural Networks

Binocular Vision Calibration and 3D Re-Construction with an Orthogonal Learning Neural Network.

Camera Calibration and Precision Analysis Based on BP Neural Network

Precise Calibration of Binocular Vision System Used for Vision Measurement.

Vision System Calibration Of Agricultural Wheeled-Mobile Robot Based On Bp Neural Network

Precise Calibration Of Binocular Vision System Used For Vision Measurement

Precision Calibration Method for Binocular Vision Measurement Systems Based on Arbitrary Translations and 3D-Connection Information

Ccd Camera Optimization Calibration Technique Using Genetic Algorithm