3D Radar and Camera Co-Calibration: A Flexible and Accurate Method for Target-based Extrinsic Calibration

Lei Cheng,Arindam Sengupta,Siyang Cao
2023-07-28
Abstract:Advances in autonomous driving are inseparable from sensor fusion. Heterogeneous sensors are widely used for sensor fusion due to their complementary properties, with radar and camera being the most equipped sensors. Intrinsic and extrinsic calibration are essential steps in sensor fusion. The extrinsic calibration, independent of the sensor's own parameters, and performed after the sensors are installed, greatly determines the accuracy of sensor fusion. Many target-based methods require cumbersome operating procedures and well-designed experimental conditions, making them extremely challenging. To this end, we propose a flexible, easy-to-reproduce and accurate method for extrinsic calibration of 3D radar and camera. The proposed method does not require a specially designed calibration environment, and instead places a single corner reflector (CR) on the ground to iteratively collect radar and camera data simultaneously using Robot Operating System (ROS), and obtain radar-camera point correspondences based on their timestamps, and then use these point correspondences as input to solve the perspective-n-point (PnP) problem, and finally get the extrinsic calibration matrix. Also, RANSAC is used for robustness and the Levenberg-Marquardt (LM) nonlinear optimization algorithm is used for accuracy. Multiple controlled environment experiments as well as real-world experiments demonstrate the efficiency and accuracy (AED error is 15.31 pixels and Acc up to 89\%) of the proposed method.
Robotics,Signal Processing,Systems and Control
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve This paper aims to address the extrinsic calibration problem between radar and camera in autonomous vehicles and mobile robots. Specifically, the research proposes a flexible, reproducible, and precise method for achieving 3D radar and camera extrinsic calibration. #### Main Issues: 1. **Limitations of Existing Methods**: Existing calibration methods often require complex operational procedures and specially designed experimental environments, making these methods difficult to reproduce and prone to interference. 2. **Instability of Radar Detection**: Due to factors such as multipath reflection, jitter, and inconsistency, radar detection results are often noisy, leading to a complex and time-consuming calibration process. 3. **Lack of Calibration Methods for 3D Radar**: Most existing methods only consider 2D radar detection and are not suitable for the promising 3D radar-related extrinsic calibration. #### Research Contributions: - **Single Corner Reflector (CR) Calibration Target**: The proposed method uses only a single corner reflector as the calibration target, avoiding the interference caused by multiple calibration targets or support structures, and making it easier for other researchers to reproduce the experiments. - **Robustness and Accuracy**: The method employs the RANSAC algorithm to filter outliers and combines the Levenberg-Marquardt optimization algorithm to improve the robustness and accuracy of the calibration. - **Validation in Practical Applications**: The effectiveness and accuracy of the method are validated through various controlled environment experiments and real-world experiments. In summary, the main objective of this paper is to develop a simple, easy-to-use, and precise 3D radar and camera extrinsic calibration method to overcome the limitations of existing methods and enhance the performance of sensor fusion systems.