Abstract:Three-dimensional point cloud registration is an important field in computer vision. Recently, due to the increasingly complex scenes and incomplete observations, many partial-overlap registration methods based on overlap estimation have been proposed. These methods heavily rely on the extracted overlapping regions with their performances greatly degraded when the overlapping region extraction underperforms. To solve this problem, we propose a partial-to-partial registration network (RORNet) to find reliable overlapping representations from the partially overlapping point clouds and use these representations for registration. The idea is to select a small number of key points called reliable overlapping representations from the estimated overlapping points, reducing the side effect of overlap estimation errors on registration. Although it may filter out some inliers, the inclusion of outliers has a much bigger influence than the omission of inliers on the registration task. The RORNet is composed of overlapping points' estimation module and representations' generation module. Different from the previous methods of direct registration after extraction of overlapping areas, RORNet adds the step of extracting reliable representations before registration, where the proposed similarity matrix downsampling method is used to filter out the points with low similarity and retain reliable representations, and thus reduce the side effects of overlap estimation errors on the registration. Besides, compared with previous similarity-based and score-based overlap estimation methods, we use the dual-branch structure to combine the benefits of both, which is less sensitive to noise. We perform overlap estimation experiments and registration experiments on the ModelNet40 dataset, outdoor large scene dataset KITTI, and natural data Stanford Bunny dataset. The experimental results demonstrate that our method is superior to other partial registration methods. Our code is available at https://github.com/superYuezhang/RORNet.

ReAgent: Point Cloud Registration using Imitation and Reinforcement Learning

CMR-Agent: Learning a Cross-Modal Agent for Iterative Image-to-Point Cloud Registration

Point Cloud Registration via Heuristic Reward Reinforcement Learning

DeepICP: An End-to-End Deep Neural Network for 3D Point Cloud Registration

An Artificial Agent for Robust Image Registration

Learning-based Point Cloud Registration: A Short Review and Evaluation.

Point Cloud Registration using Representative Overlapping Points

TrackAgent: 6D Object Tracking via Reinforcement Learning

What Stops Learning-based 3D Registration from Working in the Real World?

AlignNet-3D: Fast Point Cloud Registration of Partially Observed Objects

RoCNet: 3D Robust Registration of Point-Clouds using Deep Learning

Iterative Overlap Attention-Aware Network with Similarity Learning for Partial Point Cloud Registration

PointNetLK: Robust & Efficient Point Cloud Registration using PointNet

PointNetLK Revisited

DeepPRO: Deep Partial Point Cloud Registration of Objects

RORNet: Partial-to-Partial Registration Network With Reliable Overlapping Representations

GenReg: Deep Generative Method for Fast Point Cloud Registration

Unsupervised Point Cloud Registration with Self-Distillation

Robust Point Cloud Registration via Random Network Co-ensemble

Deep learning-based point cloud registration: a comprehensive investigation

AutoSynth: Learning to Generate 3D Training Data for Object Point Cloud Registration