Abstract:Three-dimensional (3D) point cloud registration is a fundamental step for many 3D modeling and mapping applications. Existing approaches are highly disparate in the data source, scene complexity, and application, therefore the current practices in various point cloud registration tasks are still ad-hoc processes. Recent advances in computer vision and deep learning have shown promising performance in estimating rigid/similarity transformation between unregistered point clouds of complex objects and scenes. However, their performances are mostly evaluated using a limited number of datasets from a single sensor (e.g. Kinect or RealSense cameras), lacking a comprehensive overview of their applicability in photogrammetric 3D mapping scenarios. In this work, we provide a comprehensive review of the state-of-the-art (SOTA) point cloud registration methods, where we analyze and evaluate these methods using a diverse set of point cloud data from indoor to satellite sources. The quantitative analysis allows for exploring the strengths, applicability, challenges, and future trends of these methods. In contrast to existing analysis works that introduce point cloud registration as a holistic process, our experimental analysis is based on its inherent two-step process to better comprehend these approaches including feature/keypoint-based initial coarse registration and dense fine registration through cloud-to-cloud (C2C) optimization. More than ten methods, including classic hand-crafted, deep-learning-based feature correspondence, and robust C2C methods were tested. We observed that the success rate of most of the algorithms are fewer than 40% over the datasets we tested and there are still are large margin of improvement upon existing algorithms concerning 3D sparse corresopondence search, and the ability to register point clouds with complex geometry and occlusions. With the evaluated statistics on three datasets, we conclude the best-performing methods for each step and provide our recommendations, and outlook future efforts.

Viewpoint-Aware Visibility Scoring for Point Cloud Registration in Loop Closure

Efficient 3D LIDAR Based Loop Closing Using Deep Neural Network

A New Method for Registration of 3d Point Sets with Low Overlapping Ratios

Loop Closure Detection by Using Global and Local Features With Photometric and Viewpoint Invariance

Accurate real-time SLAM based on two-step registration and multimodal loop detection

Viewpoint-Invariant Loop Closure Detection Using Step-Wise Learning With Controlling Embeddings of Landmarks

Adaptive bird's eye view description for long-term mapping and loop closure in 3D point clouds

Efficient and Deterministic Search Strategy Based on Residual Projections for Point Cloud Registration with Correspondences

Loop Closure Detection Based on Object-level Spatial Layout and Semantic Consistency

Panoramic annular SLAM with loop closure and global optimization

Point cloud registration for LiDAR and photogrammetric data: A critical synthesis and performance analysis on classic and deep learning algorithms

A Brief Review on Loop Closure Detection with 3D Point Cloud

With Fused Point Cloud Height and Intensity Information improved the Loop Closure Detection for LeGO-LOAM

Robust point cloud registration using Hough voting-based correspondence outlier rejection

LiPMatch: LiDAR Point Cloud Plane Based Loop-Closure

LiDAR-IMU Tightly-Coupled SLAM Method Based on IEKF and Loop Closure Detection

Quatro++: Robust Global Registration Exploiting Ground Segmentation for Loop Closing in LiDAR SLAM

Multi-View Laser Point Cloud Global Registration for a Single Object

When-to-Loop: Enhanced Loop Closure for LiDAR SLAM in Urban Environments Based on SCAN CONTEXT

Loop closure detection using local 3D deep descriptors

A LiDAR/Visual SLAM Backend with Loop Closure Detection and Graph Optimization