Abstract:Point cloud registration is a fundamental task for estimating the rigid transformation matrix between two point clouds, and is regarded as a prerequisite for downstream vision tasks. Recent works have sought to address the registration problem using the obtainable RGB-D sequence, rather than relying solely on point clouds, which may not always be available. However, most existing unsupervised RGB-D point cloud registration works struggle to obtain fine-grained, robust, discriminative correspondences due to the simple concatenation of multimodal features and the increase in vector dimensions. These methods typically follow a common paradigm: extracting features from the input data, estimating correspondences, and obtaining the transformation matrix through geometric fitting. In this work, we design a generative feature extraction module to fully leverage multimodal information, and seek a novel perspective for correspondence estimation which expands the points in the source and target point clouds into hyperrectangle-based embeddings and considers their inner relationships, based on intersections in n-dimensional space, as the basis for estimating correspondences. Each hyperrectangle-based embedding is built upon the natural and discriminative semantics from the proposed generative feature extraction module, which involves a diffusion branch, a geometric branch, and point-pixel fusion. We harness the capability of the generative model to fully leverage the information from both complementary modalities in RGB-D frames. Furthermore, this distinctive geometry space allows for efficient calculation of intersection volumes and model conditional probabilistics for estimating correspondences. Extensive experiments on the 3DMatch and ScanNet datasets show the effectiveness of the proposed method in this challenging task, outperforming state-of-the-art approaches. Our code will be released at: https://github.com/cbyan1003/DCE.

Boosting RGB-D Point Cloud Registration Via Explicit Position-Aware Geometric Embedding

Discriminative Correspondence Estimation for Unsupervised RGB-D Point Cloud Registration

Improving RGB-D Point Cloud Registration by Learning Multi-scale Local Linear Transformation

RGB-D Point Cloud Registration Based on Salient Object Detection

RGBD-Glue: General Feature Combination for Robust RGB-D Point Cloud Registration

PointMBF: A Multi-scale Bidirectional Fusion Network for Unsupervised RGB-D Point Cloud Registration

RGB-D Point Cloud Registration Via Infrared and Color Camera

PCR-CG: Point Cloud Registration via Deep Explicit Color and Geometry

DeepICP: An End-to-End Deep Neural Network for 3D Point Cloud Registration

Color Point Cloud Registration Based on Supervoxel Correspondence

Hybrid3D: learning 3D hybrid features with point clouds and multi-view images for point cloud registration

Two-view point cloud registration network: feature and geometry

ColorPCR: Color Point Cloud Registration with Multi-Stage Geometric-Color Fusion

Geometry-Aware Enhanced Mutual-Supervised Point Elimination with Overlapping Mask Contrastive Learning for Partitial Point Cloud Registration

3D Point Cloud Registration Method Based on Deep and Shallow Features Combined with Attention Enhancement

Boosting 3D Point Cloud Registration by Transferring Multi-modality Knowledge

GERA: Geometric Embedding for Efficient Point Registration Analysis

Robust Rigid Registration Algorithm Based on Correntropy and Bi-Directional Distance.

An Unsupervised Approach for Robust Point Cloud Registration with Deep Feature

SGNet: Salient Geometric Network for Point Cloud Registration

SGFeat: Salient Geometric Feature for Point Cloud Registration