SGNet: Salient Geometric Network for Point Cloud Registration

Qianliang Wu,Yaqing Ding,Lei Luo,Haobo Jiang,Shuo Gu,Chuanwei Zhou,Jin Xie,Jian Yang

2024-08-28

Abstract:Point Cloud Registration (PCR) is a critical and challenging task in computer vision. One of the primary difficulties in PCR is identifying salient and meaningful points that exhibit consistent semantic and geometric properties across different scans. Previous methods have encountered challenges with ambiguous matching due to the similarity among patch blocks throughout the entire point cloud and the lack of consideration for efficient global geometric consistency. To address these issues, we propose a new framework that includes several novel techniques. Firstly, we introduce a semantic-aware geometric encoder that combines object-level and patch-level semantic information. This encoder significantly improves registration recall by reducing ambiguity in patch-level superpoint matching. Additionally, we incorporate a prior knowledge approach that utilizes an intrinsic shape signature to identify salient points. This enables us to extract the most salient super points and meaningful dense points in the scene. Secondly, we introduce an innovative transformer that encodes High-Order (HO) geometric features. These features are crucial for identifying salient points within initial overlap regions while considering global high-order geometric consistency. To optimize this high-order transformer further, we introduce an anchor node selection strategy. By encoding inter-frame triangle or polyhedron consistency features based on these anchor nodes, we can effectively learn high-order geometric features of salient super points. These high-order features are then propagated to dense points and utilized by a Sinkhorn matching module to identify key correspondences for successful registration. In our experiments conducted on well-known datasets such as 3DMatch/3DLoMatch and KITTI, our approach has shown promising results, highlighting the effectiveness of our novel method.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### The Problem Addressed by the Paper

The paper "SGNet: Salient Geometric Network for Point Cloud Registration" aims to address key issues in Point Cloud Registration (PCR). Specifically, the authors focus on how to identify salient and meaningful points with consistent semantic and geometric characteristics across different scans. Existing methods face the following challenges when dealing with point cloud registration:

1. **Ambiguous Matching**: Due to the similarity of block regions within the entire point cloud, there is a significant amount of ambiguous matching during the process.
2. **Lack of Global Geometric Consistency**: Existing methods are insufficient in considering efficient global geometric consistency.

To tackle these challenges, the authors propose a new framework that includes the following innovative techniques:

1. **Semantic-Aware Geometric Encoder**: By combining object-level and block-level semantic information, it significantly improves the recall rate of block-level superpoint matching.
2. **Prior Knowledge Method**: Utilizing intrinsic shape signatures to identify salient points, thereby extracting the most salient superpoints and dense points in the scene.
3. **High-Order Geometric Feature Transformer**: Introducing a new transformer to encode high-order geometric features, which are crucial for identifying salient points within the initial overlapping region and can consider global high-order geometric consistency.
4. **Anchor Point Selection Strategy**: Optimizing the high-order transformer through an anchor-based selection strategy, further enhancing the learning effect of high-order geometric features.

Experimental results show that this method performs excellently on the 3DMatch/3DLoMatch and KITTI datasets, effectively addressing the aforementioned issues.