Abstract:Estimating the relative pose between a camera and a LiDAR holds paramount importance in facilitating complex task execution within multi-agent systems. Nonetheless, current methodologies encounter two primary limitations. First, amid the cross-modal feature extraction, they typically employ separate modal branches to extract cross-modal features from images and point clouds. This approach results in the feature spaces of images and point clouds being misaligned, thereby reducing the robustness of establishing correspondences. Second, due to the scale differences between images and point clouds, one-to-many pixel-point correspondences are inevitably encountered, which will mislead the pose optimization. To address these challenges, we propose a framework named \(\text{I2P}_{\text{ppsim}}\) ( I mage to P oint cloud registration by learning the underlying alignment feature space from P ixel-to- P oint SIM ilarities). Central to \(\text{I2P}_{\text{ppsim}}\) is a shared feature alignment module (SFAM). It is designed under on a coarse-to-fine architecture and uses a weight-sharing network to construct an alignment feature space. Benefiting from SFAM, \(\text{I2P}_{\text{ppsim}}\) can effectively identify the co-view regions between images and point clouds and establish high-reliability 2D-3D correspondences. Moreover, to mitigate the one-to-many correspondence issue, we introduce a similarity maximization strategy termed point-max. This strategy effectively filters out outliers, thereby establishing accurate 2D-3D correspondences. To evaluate the efficacy of our framework, we conduct extensive experiments on KITTI Odometry and Oxford Robotcar. The results corroborate the effectiveness of our framework in improving image-to-point cloud registration. To make our results reproducible, the source codes have been released at https://cslinzhang.github.io/I2P .

ICP Algorithm: Theory, Practice And Its SLAM-oriented Taxonomy

Em-Based Point to Plane Icp for 3d Simultaneous Localization and Mapping

Probabilistic 3D ICP algorithm based on ORB feature

Map Alignment Based on Plicp Algorithm for Multi-Robot Slam

I2P Registration by Learning the Underlying Alignment Feature Space from Pixel-to-Point Similarities

A Survey on the ICP Algorithm and Its Variants in Registration of 3D Point Clouds

Geometry-Aware ICP for Scene Reconstruction from RGB-D Camera

ICP Based on Polar Point Matching with Application to Graph-SLAM

Visual-Inertial Odometry-enhanced Geometrically Stable ICP for Mapping Applications using Aerial Robots

BO-ICP: Initialization of Iterative Closest Point Based on Bayesian Optimization

NIMLS-ICP: an ICP Variant Suitable for Substation Scenarios

A Global Structure and Adaptive Weight Aware ICP Algorithm for Image Registration

Improving the Iterative Closest Point Algorithm using Lie Algebra

WA-ICP Algorithm for Tackling Ambiguous Correspondence

SLAMICP Library: Accelerating Obstacle Detection in Mobile Robot Navigation via Outlier Monitoring following ICP Localization

Comparing ICP variants on real-world data sets

Integrate Point-Cloud Segmentation with 3D LiDAR Scan-Matching for Mobile Robot Localization and Mapping

Simulation of Registration Accuracy of Iterative Closest Point (ICP) Method for Pose Estimation

Go-ICP: Solving 3D Registration Efficiently and Globally Optimally

Multi-relation Octomap Based Heuristic ICP for Air/surface Robots Cooperation.

TCM-ICP: Transformation Compatibility Measure for Registering Multiple LIDAR Scans