Memory-Efficient Point Cloud Registration via Overlapping Region Sampling

Tomoyasu Shimada,Kazuhiko Murasaki,Shogo Sato,Toshihiko Nishimura,Taiga Yoshida,Ryuichi Tanida

2024-10-29

Abstract:Recent advances in deep learning have improved 3D point cloud registration but increased graphics processing unit (GPU) memory usage, often requiring preliminary sampling that reduces accuracy. We propose an overlapping region sampling method to reduce memory usage while maintaining accuracy. Our approach estimates the overlapping region and intensively samples from it, using a k-nearest-neighbor (kNN) based point compression mechanism with multi layer perceptron (MLP) and transformer architectures. Evaluations on 3DMatch and 3DLoMatch datasets show our method outperforms other sampling methods in registration recall, especially at lower GPU memory levels. For 3DMatch, we achieve 94% recall with 33% reduced memory usage, with greater advantages in 3DLoMatch. Our method enables efficient large-scale point cloud registration in resource-constrained environments, maintaining high accuracy while significantly reducing memory requirements.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

This paper aims to address the issue of high GPU memory consumption in large-scale 3D point cloud registration. Specifically, while deep learning-based methods have significantly improved the accuracy of 3D point cloud registration in recent years, they have also increased GPU memory usage, which is particularly evident when processing large-scale point clouds. To tackle this challenge, pre-sampling techniques are commonly used to reduce the number of points processed, but this can lead to the loss of critical geometric information, thereby affecting registration accuracy.

To solve these problems, this paper proposes a novel overlapping region sampling method that focuses on sampling points within overlapping regions, reducing memory usage while maintaining registration accuracy. The method consists of three main stages:

1. **Point Cloud Compression**: Compress the point cloud through random sampling and k-nearest neighbors (kNN) feature extraction, combined with multi-layer perceptron (MLP) and transformer architectures.
2. **Overlapping Region Estimation**: Use the PREDATOR framework to estimate the overlapping regions between point clouds and generate overlap scores and match scores for each point.
3. **Sampling**: Select the most relevant points for subsequent registration steps based on the overlap scores and match scores.

Experimental results show that this method performs excellently on the 3DMatch and 3DLoMatch datasets, significantly reducing GPU memory usage while maintaining or even improving registration recall. This makes the method particularly suitable for large-scale point cloud registration tasks in resource-constrained environments.