Abstract:LiDAR-binocular camera systems have attracted increasing research attention with their advantages of two sensors. The two-sensor data fusion premise accurately calibrates the external parameters of both sensors. However, existing LiDAR and binocular camera calibration uses geometric methods to calibrate the left and right cameras with the LiDAR or register the LiDAR point cloud and camera depth map to obtain the extrinsic parameters. Existing methods have difficulty obtaining low binocular camera baseline length and reprojection errors simultaneously. This article proposes a binocular camera and LiDAR extrinsic parameter calibration method based on a back propagation (BP) neural network and checkerboard. First, a LiDAR-binocular camera calibration model is established, and the extrinsic parameters and intermediate variables to be calibrated are determined. The calibration rotation matrix has multiple variables that are not independent of each other, creating a complex model. The nine rotation matrix variables are decoupled and reduced using the Euler angle representation. Then, the BP neural network structure is determined using the external parameter calibration data characteristics. The calibration algorithm accuracy is improved by introducing the baseline and reprojection errors into the loss function. Finally, we use real data to check the calibration performance and introduce the baseline length and reprojection errors as indicators to improve the calibration result evaluation accuracy and effectiveness. The results show that the proposed calibration method has good consistency and small baseline and reprojection errors. Compared with traditional perspective-n-point (PnP) methods, the average baseline error is reduced by 64.804%, and the reprojection error is reduced by approximately 10%.

Camera Calibration of Binocular Vision System Based on BP Neural Network

Genetic Optimized Bp Network Method for Camera Calibration in Binocular Vision

Precise and Robust Binocular Camera Calibration Based on Multiple Constraints

Linear CCD camera calibration of exterior attitude measurement system based on BP neural network

Research on the Calibration of Binocular Camera Based on BP Neural Network Optimized by Improved Genetic Simulated Annealing Algorithm

Vision System Calibration for Soccer Robot Based on BP Network (7)

Research on Camera Self-Calibration of High-Precision in Binocular Vision

Camera Calibration and Precision Analysis Based on BP Neural Network

A Novel Camera Calibration Method for Binocular Vision Based on Improved RBF Neural Network

Extrinsic Calibration of a Binocular Camera and LiDAR Based on Neural Networks

Vision System Calibration Of Agricultural Wheeled-Mobile Robot Based On Bp Neural Network

Development of Machine Vision System Based on BP Neural Network Self-learning

Camera Calibration of Binocular Vision Based on Virtual 1D Target

Research of Camera Calibration Based on Genetic Algorithm BP Neural Network

Study on Camera Calibration for Binocular Vision Based on GEP

A Camera Calibration Method Based on Neural Network Optimized by Genetic Algorithm

A Hybrid Calibration Method for the Binocular Omnidirectional Vision System

Binocular Vision Calibration and 3D Re-Construction with an Orthogonal Learning Neural Network.

Camera Calibration in Computer Vision Based on Artificial Neural Network

Binocular vision calibration and 3D re-construction with an orthogonal learning neural network

Precision Calibration Method for Binocular Vision Measurement Systems Based on Arbitrary Translations and 3D-Connection Information