Abstract:Three-dimensional (3D) point cloud registration is a fundamental step for many 3D modeling and mapping applications. Existing approaches are highly disparate in the data source, scene complexity, and application, therefore the current practices in various point cloud registration tasks are still ad-hoc processes. Recent advances in computer vision and deep learning have shown promising performance in estimating rigid/similarity transformation between unregistered point clouds of complex objects and scenes. However, their performances are mostly evaluated using a limited number of datasets from a single sensor (e.g. Kinect or RealSense cameras), lacking a comprehensive overview of their applicability in photogrammetric 3D mapping scenarios. In this work, we provide a comprehensive review of the state-of-the-art (SOTA) point cloud registration methods, where we analyze and evaluate these methods using a diverse set of point cloud data from indoor to satellite sources. The quantitative analysis allows for exploring the strengths, applicability, challenges, and future trends of these methods. In contrast to existing analysis works that introduce point cloud registration as a holistic process, our experimental analysis is based on its inherent two-step process to better comprehend these approaches including feature/keypoint-based initial coarse registration and dense fine registration through cloud-to-cloud (C2C) optimization. More than ten methods, including classic hand-crafted, deep-learning-based feature correspondence, and robust C2C methods were tested. We observed that the success rate of most of the algorithms are fewer than 40% over the datasets we tested and there are still are large margin of improvement upon existing algorithms concerning 3D sparse corresopondence search, and the ability to register point clouds with complex geometry and occlusions. With the evaluated statistics on three datasets, we conclude the best-performing methods for each step and provide our recommendations, and outlook future efforts.

Research and Application on Cross-source Point Cloud Registration Method Based on Unsupervised Learning

An Unsupervised Approach for Robust Point Cloud Registration with Deep Feature

A comprehensive survey on point cloud registration

Unsupervised Learning of 3D Point Set Registration

Learning-based Point Cloud Registration: A Short Review and Evaluation.

A Representation Separation Perspective to Correspondence-Free Unsupervised 3-D Point Cloud Registration.

Semi-supervised Deep Closest Point Method for Point Cloud Registration

A Novel Method for Registration of MLS and Stereo Reconstructed Point Clouds

A Systematic Approach for Cross-source Point Cloud Registration by Preserving Macro and Micro Structures

Point cloud registration for LiDAR and photogrammetric data: A critical synthesis and performance analysis on classic and deep learning algorithms

A Representation Separation Perspective to Correspondences-free Unsupervised 3D Point Cloud Registration

Learning a 3D descriptor for cross-source point cloud registration from synthetic data

AMCNet: Adaptive Matching Constraint for Unsupervised Point Cloud Registration.

Self-Supervised Point Cloud Registration With Deep Versatile Descriptors for Intelligent Driving

Exploring Self-Supervised Learning for 3D Point Cloud Registration

Fast Registration for cross-source point clouds by using weak regional affinity and pixel-wise refinement

Learning Discriminative Features Via Multi-Hierarchical Mutual Information for Unsupervised Point Cloud Registration

Unsupervised Point Cloud Registration by Learning Unified Gaussian Mixture Models

Sampling Network Guided Cross-Entropy Method for Unsupervised Point Cloud Registration

VRHCF: Cross-Source Point Cloud Registration via Voxel Representation and Hierarchical Correspondence Filtering

Unsupervised Deep Probabilistic Approach for Partial Point Cloud Registration