Abstract:Estimating the relative pose between a camera and a LiDAR holds paramount importance in facilitating complex task execution within multi-agent systems. Nonetheless, current methodologies encounter two primary limitations. First, amid the cross-modal feature extraction, they typically employ separate modal branches to extract cross-modal features from images and point clouds. This approach results in the feature spaces of images and point clouds being misaligned, thereby reducing the robustness of establishing correspondences. Second, due to the scale differences between images and point clouds, one-to-many pixel-point correspondences are inevitably encountered, which will mislead the pose optimization. To address these challenges, we propose a framework named \(\text{I2P}_{\text{ppsim}}\) ( I mage to P oint cloud registration by learning the underlying alignment feature space from P ixel-to- P oint SIM ilarities). Central to \(\text{I2P}_{\text{ppsim}}\) is a shared feature alignment module (SFAM). It is designed under on a coarse-to-fine architecture and uses a weight-sharing network to construct an alignment feature space. Benefiting from SFAM, \(\text{I2P}_{\text{ppsim}}\) can effectively identify the co-view regions between images and point clouds and establish high-reliability 2D-3D correspondences. Moreover, to mitigate the one-to-many correspondence issue, we introduce a similarity maximization strategy termed point-max. This strategy effectively filters out outliers, thereby establishing accurate 2D-3D correspondences. To evaluate the efficacy of our framework, we conduct extensive experiments on KITTI Odometry and Oxford Robotcar. The results corroborate the effectiveness of our framework in improving image-to-point cloud registration. To make our results reproducible, the source codes have been released at https://cslinzhang.github.io/I2P .

NIMLS-ICP: an ICP Variant Suitable for Substation Scenarios

Em-Based Point to Plane Icp for 3d Simultaneous Localization and Mapping

Map Alignment Based on Plicp Algorithm for Multi-Robot Slam

Probabilistic 3D ICP algorithm based on ORB feature

Integrate Point-Cloud Segmentation with 3D LiDAR Scan-Matching for Mobile Robot Localization and Mapping

MIM_SLAM: A Multi-Level ICP Matching Method for Mobile Robot in Large-Scale and Sparse Scenes

I2P Registration by Learning the Underlying Alignment Feature Space from Pixel-to-Point Similarities

Improved ICP Matching Algorithm Based on Laser Radar and IMU.

ICP Based on Polar Point Matching with Application to Graph-SLAM

ICP-based SLAM Using LiDAR Intensity and Near-infrared Data*

ICP Algorithm: Theory, Practice And Its SLAM-oriented Taxonomy

SLAMICP Library: Accelerating Obstacle Detection in Mobile Robot Navigation via Outlier Monitoring following ICP Localization

Real-Time 2-D Lidar Odometry Based on ICP

A Low-Cost 3D SLAM System Integration of Autonomous Exploration Based on Fast-ICP Enhanced LiDAR-Inertial Odometry

QN-SAM-LIVO: A Multi-Sensor Tightly Coupled SLAM Framework Based on Coarse-to-Fine Loop Closure Detection.

Visual-Inertial Odometry-enhanced Geometrically Stable ICP for Mapping Applications using Aerial Robots

Real-Time Autonomous Localization in Multi-Robot Scene

Automatic Non-Rigid Registration of Multi-Strip Point Clouds from Mobile Laser Scanning Systems

MSCS-ICP: Point cloud registration method using multi-view spatial coordinate system–ICP

Indoor Point Cloud Registration Process Using ICP Algorithm

Feature Scan Context Aided Lidar-IMU Simultaneously Localization and Mapping