Abstract:With the development of autonomous driving technology, sensor calibration has become a key technology to achieve accurate perception fusion and localization. Accurate calibration of the sensors ensures that each sensor can function properly and accurate information aggregation can be achieved. Among them, camera calibration based on surround view has received extensive attention. In autonomous driving applications, the calibration accuracy of the camera can directly affect the accuracy of perception and depth estimation. For online calibration of surround-view cameras, traditional feature extraction-based methods will suffer from strong distortion when the initial extrinsic parameters error is large, making these methods less robust and inaccurate. More existing methods use the sparse direct method to calibrate multi-cameras, which can ensure both accuracy and real-time performance and is theoretically achievable. However, this method requires a better initial value, and the initial estimate with a large error is often stuck in a local optimum. To this end, we introduce a robust automatic multi-cameras (pinhole or fisheye cameras) calibration and refinement method in the road scene. We utilize the coarse-to-fine random-search strategy, and it can solve large disturbances of initial extrinsic parameters, which can make up for falling into optimal local value in nonlinear optimization methods. In the end, quantitative and qualitative experiments are conducted in actual and simulated environments, and the result shows the proposed method can achieve accuracy and robustness performance. The open-source code is available at <a class="link-external link-https" href="https://github.com/OpenCalib/SurroundCameraCalib" rel="external noopener nofollow">this https URL</a>.

A Survey on Extrinsic Self-calibration Algorithms for Cameras Without Overlapping Field of Views

An accurate extrinsic camera self-calibration method in non-overlapping camera sensor networks

Intrinsic and Extrinsic Calibration of Roadside LiDAR and Camera

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Simultaneous Intrinsic And Extrinsic Calibration Of A Visual-Odometric Sensor System

Extrinsic Calibration of a Single-Point Laser Rangefinder and Single Camera

Efficient and robust camera extrinsic parameters calibration algorithm

Effective camera calibration in free-viewpoint systems

Adaptive Recursive Optimized Extrinsic Self-Calibration in Distributed Visual Sensor Networks

Extrinsic Parameters Self-calibration Algorithm for Surveillance Camera Integrating Ground-Pedestrian Constraints

Camera Self-Calibration from Multi-View Images

An Extrinsic Calibration Method for Multiple Infrastructure RGB-D Camera Networks with Small FOV

Online Extrinsic Parameter Calibration for Robotic Camera–Encoder System

An Online Automatic Calibration Method Based on Feature Descriptor for Non-Overlapping Multi-Camera Systems

Automatic Surround Camera Calibration Method in Road Scene for Self-driving Car

Automatic Calibration of Multi-Camera Networks

Camera External Self-Calibration for Intelligent Vehicles

Automatic targetless LiDAR–camera calibration: a survey

CamMap: Extrinsic Calibration of Non-Overlapping Cameras Based on SLAM Map Alignment

A tractable mechanism for external calibration in non-overlapping camera network

A New Calibration Technique For Multi-Camera Systems Of Limited Overlapping Field-Of-Views