Abstract:Multisensor (MS) data fusion is important for improving the stability of vehicle environmental perception systems. MS joint calibration is a prerequisite for the fusion of multimodality sensors. Traditional calibration methods based on calibration boards require the manual extraction of many features and manual registration, resulting in a cumbersome calibration process and significant errors. A joint calibration algorithm for a Light Laser Detection and Ranging (LiDAR) and camera is proposed based on deep learning without the need for other special calibration objects. A network model constructed based on deep learning can automatically capture object features in the environment and complete the calibration by matching and calculating object features. A mathematical model was constructed for joint LiDAR-camera calibration, and the process of sensor joint calibration was analyzed in detail. By constructing a deep-learning-based network model to determine the parameters of the rotation matrix and translation matrix, the relative spatial positions of the two sensors were determined to complete the joint calibration. The network model consists of three parts: a feature extraction module, a feature-matching module, and a feature aggregation module. The feature extraction module extracts the image features of color and depth images, the feature-matching module calculates the correlation between the two, and the feature aggregation module determines the calibration matrix parameters. The proposed algorithm was validated and tested on the KITTI-odometry dataset and compared with other advanced algorithms. The experimental results show that the average translation error of the calibration algorithm is 0.26 cm, and the average rotation error is 0.02°. The calibration error is lower than those of other advanced algorithms.

Deep neural network based calibration for freeform surface misalignments in general interferometer.

Enhanced Calibration for Freeform Surface Misalignments in Non-Null Interferometers by Convolutional Neural Network.

Misalignment Correction for Free-Form Surface in Non-Null Interferometric Testing

Aspheric and Free-Form Surfaces Test with Non-Null Sub-Aperture Stitching

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

A Novel Hand-Eye Semi-Automatic Calibration Process for Laser Profilometers Using Machine Learning

Practical and Accurate Method for Aspheric Misalignment Aberrations Calibration in Non-Null Interferometric Testing

Model Calibration by Multi-Null Constraint for an Optical Freeform Surface Adaptive Interferometer

Calibration of misalignment errors in the non-null interferometry based on reverse iteration optimization algorithm

Adaptive Optics Based Non-Null Interferometry for Optical Free Form Surfaces Test

Virtual Interferometer Calibration Method of a Non-Null Interferometer for Freeform Surface Measurements.

In‐Situ Wavefront Correction Via Physics‐Informed Neural Network

Fiducial-aided Calibration of a Displacement Laser Probing System for In-Situ Measurement of Optical Freeform Surfaces on an Ultra-Precision Fly-Cutting Machine.

Sub-Nanometer Misalignment Aberrations Calibration of the Fizeau Interferometer for High-Numerical-Aperture Spherical Surface Ultra-Precision Measurement

Pure adaptive interferometer for free form surfaces metrology.

Model-based adaptive non-null interferometry for freeform surface metrology

Deep learning-based method for non-uniform motion-induced error reduction in dynamic microscopic 3D shape measurement

Camera Geometric Calibration Using Dynamic Single-Pixel Illumination With Deep Learning Networks

A LiDAR-Camera Joint Calibration Algorithm Based on Deep Learning

A novel calibration approach to structured light 3D vision inspection

Self-calibration of in Situ Monoscopic Deflectometric Measurement in Precision Optical Manufacturing.