V2I-Calib: A Novel Calibration Approach for Collaborative Vehicle and Infrastructure LiDAR Systems

Qianxin Qu,Yijin Xiong,Guipeng Zhang,Xin Wu,Xiaohan Gao,Xin Gao,Hanyu Li,Shichun Guo,Guoying Zhang
2024-09-18
Abstract:Cooperative LiDAR systems integrating vehicles and road infrastructure, termed V2I calibration, exhibit substantial potential, yet their deployment encounters numerous challenges. A pivotal aspect of ensuring data accuracy and consistency across such systems involves the calibration of LiDAR units across heterogeneous vehicular and infrastructural endpoints. This necessitates the development of calibration methods that are both real-time and robust, particularly those that can ensure robust performance in urban canyon scenarios without relying on initial positioning values. Accordingly, this paper introduces a novel approach to V2I calibration, leveraging spatial association information among perceived objects. Central to this method is the innovative Overall Intersection over Union (oIoU) metric, which quantifies the correlation between targets identified by vehicle and infrastructure systems, thereby facilitating the real-time monitoring of calibration results. Our approach involves identifying common targets within the perception results of vehicle and infrastructure LiDAR systems through the construction of an affinity matrix. These common targets then form the basis for the calculation and optimization of extrinsic parameters. Comparative and ablation studies conducted using the DAIR-V2X dataset substantiate the superiority of our approach. For further insights and resources, our project repository is accessible at <a class="link-external link-https" href="https://github.com/MassimoQu/v2i-calib" rel="external noopener nofollow">this https URL</a>.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: in the Vehicle - to - Infrastructure (V2I) lidar system, how to achieve efficient, accurate and real - time cross - source point cloud registration (calibration), especially in complex environments such as urban canyons, and ensure the robustness and accuracy of the system without relying on the initial positioning values. ### Specific problem description 1. **Challenges in cross - source point cloud registration**: - The lidar systems of vehicles and infrastructure are heterogeneous endpoints, and there are significant differences in the point cloud data between them. - Traditional point cloud registration methods may not be directly applicable in this case because these methods usually assume that the point clouds come from the same source or known initial parameters. 2. **Requirements for real - time performance and robustness**: - The registration method needs to have real - time processing capabilities to adapt to rapid changes in dynamic environments. - High precision and robustness still need to be ensured without initial extrinsic parameters, especially in complex scenarios such as urban canyons. 3. **Limitations of existing methods**: - Existing methods usually rely on initial extrinsic parameters, which may be unstable in practical applications. - Complex computational requirements make it difficult for some methods to achieve real - time processing. ### Solutions proposed in the paper To solve the above problems, the paper proposes a new calibration method named **V2I - Calib**, and the main innovations include: 1. **Introduction of a new metric**: - The **Overall Intersection over Union (oIoU)** metric is proposed to quantify the correlation between the targets identified by the vehicle and infrastructure systems. - oIoU not only considers the overlapping area of the targets but also combines the positional relationship, providing a more comprehensive spatial alignment evaluation. 2. **Construction of an affinity matrix**: - An affinity matrix is constructed to identify common targets in the vehicle and infrastructure perception results. - These common targets are used to calculate and optimize extrinsic parameters, thereby achieving efficient point cloud registration. 3. **No need for initial extrinsic parameters**: - The V2I - Calib method does not require initial extrinsic parameters, reducing the dependence on external conditions and enhancing the stability and applicability of the system. 4. **Real - time processing capabilities**: - This method can meet the requirements of real - time operation and is suitable for rapid response in dynamic environments. 5. **Reduction of computational complexity**: - By using perception information for target detection, the computational complexity and data transmission cost are reduced, and the feasibility of practical applications is improved. ### Experimental verification The paper verifies the effectiveness of the V2I - Calib method through experiments on the **DAIR - V2X** dataset. The experimental results show that this method exhibits high precision and robustness in both simple and complex scenarios, and has a significant advantage especially in real - time processing. ### Summary In general, this paper aims to solve the challenges of cross - source point cloud registration in the Vehicle - to - Infrastructure lidar system, proposes a new method that does not require initial extrinsic parameters and has real - time processing capabilities, and provides strong support for improving the safety and reliability of autonomous driving systems.