Abstract:Three-dimensional (3D) point cloud registration is a fundamental step for many 3D modeling and mapping applications. Existing approaches are highly disparate in the data source, scene complexity, and application, therefore the current practices in various point cloud registration tasks are still ad-hoc processes. Recent advances in computer vision and deep learning have shown promising performance in estimating rigid/similarity transformation between unregistered point clouds of complex objects and scenes. However, their performances are mostly evaluated using a limited number of datasets from a single sensor (e.g. Kinect or RealSense cameras), lacking a comprehensive overview of their applicability in photogrammetric 3D mapping scenarios. In this work, we provide a comprehensive review of the state-of-the-art (SOTA) point cloud registration methods, where we analyze and evaluate these methods using a diverse set of point cloud data from indoor to satellite sources. The quantitative analysis allows for exploring the strengths, applicability, challenges, and future trends of these methods. In contrast to existing analysis works that introduce point cloud registration as a holistic process, our experimental analysis is based on its inherent two-step process to better comprehend these approaches including feature/keypoint-based initial coarse registration and dense fine registration through cloud-to-cloud (C2C) optimization. More than ten methods, including classic hand-crafted, deep-learning-based feature correspondence, and robust C2C methods were tested. We observed that the success rate of most of the algorithms are fewer than 40% over the datasets we tested and there are still are large margin of improvement upon existing algorithms concerning 3D sparse corresopondence search, and the ability to register point clouds with complex geometry and occlusions. With the evaluated statistics on three datasets, we conclude the best-performing methods for each step and provide our recommendations, and outlook future efforts.

ROI-cloud: A Key Region Extraction Method for LiDAR Odometry and Localization.

3D LiDAR Map Compression Using Deep Neural Network.

Communication Constrained Cloud-Based Long-Term Visual Localization in Real Time.

An Improved Supervoxel Clustering Algorithm of 3D Point Clouds for the Localization of Industrial Robots

Efficient LiDAR Odometry for Autonomous Driving.

LiDAR-Generated Images Derived Keypoints Assisted Point Cloud Registration Scheme in Odometry Estimation

Visual Localization in a Prior 3D LiDAR Map Combining Points and Lines

Quadric Representations for LiDAR Odometry, Mapping and Localization

A Novel Approach to the Extraction of Key Points from 3-D Rigid Point Cloud Using 2-D Images Transformation

Global Localization in Large-scale Point Clouds via Roll-pitch-yaw Invariant Place Recognition and Low-overlap Global Registration

VMB module for Low Overlap Point Cloud Registration

Instance Segmentation of Sparse Point Clouds with Spatio-Temporal Coding for Autonomous Robot

Point cloud registration and localization based on voxel plane features

OKR-Net: Overlapping Keypoints Registration Network for Large-Scale LiDAR Point Clouds

Point cloud registration for LiDAR and photogrammetric data: A critical synthesis and performance analysis on classic and deep learning algorithms

L-PR: Exploiting LiDAR Fiducial Marker for Unordered Low Overlap Multiview Point Cloud Registration

POU-SLAM: Scan-to-Model Matching Based on 3D Voxels

Ground-LIO: Enhanced LiDAR-Inertial Odometry for Ground Robots based on Ground Optimization

Sift Based Automatic Roi Localization and Designation

A Speedy Point Cloud Registration Method Based on Region Feature Extraction in Intelligent Driving Scene