Abstract:Three-dimensional (3D) point cloud registration is a fundamental step for many 3D modeling and mapping applications. Existing approaches are highly disparate in the data source, scene complexity, and application, therefore the current practices in various point cloud registration tasks are still ad-hoc processes. Recent advances in computer vision and deep learning have shown promising performance in estimating rigid/similarity transformation between unregistered point clouds of complex objects and scenes. However, their performances are mostly evaluated using a limited number of datasets from a single sensor (e.g. Kinect or RealSense cameras), lacking a comprehensive overview of their applicability in photogrammetric 3D mapping scenarios. In this work, we provide a comprehensive review of the state-of-the-art (SOTA) point cloud registration methods, where we analyze and evaluate these methods using a diverse set of point cloud data from indoor to satellite sources. The quantitative analysis allows for exploring the strengths, applicability, challenges, and future trends of these methods. In contrast to existing analysis works that introduce point cloud registration as a holistic process, our experimental analysis is based on its inherent two-step process to better comprehend these approaches including feature/keypoint-based initial coarse registration and dense fine registration through cloud-to-cloud (C2C) optimization. More than ten methods, including classic hand-crafted, deep-learning-based feature correspondence, and robust C2C methods were tested. We observed that the success rate of most of the algorithms are fewer than 40% over the datasets we tested and there are still are large margin of improvement upon existing algorithms concerning 3D sparse corresopondence search, and the ability to register point clouds with complex geometry and occlusions. With the evaluated statistics on three datasets, we conclude the best-performing methods for each step and provide our recommendations, and outlook future efforts.

ERS: Faster LiDAR Point Cloud Registration for Connected Vehicles

EEPNet: Efficient Edge Pixel-based Matching Network for Cross-Modal Dynamic Registration between LiDAR and Camera

A Speedy Point Cloud Registration Method Based on Region Feature Extraction in Intelligent Driving Scene

VI-eye: semantic-based 3D point cloud registration for infrastructure-assisted autonomous driving

Traffic Sign Based Point Cloud Data Registration with Roadside LiDARs in Complex Traffic Environments

Extend Your Own Correspondences: Unsupervised Distant Point Cloud Registration by Progressive Distance Extension

A Stepwise Minimum Spanning Tree Matching Method for Registering Vehicle-Borne and Backpack LiDAR Point Clouds

HPCR-VI: Heterogeneous Point Cloud Registration for Vehicle-Infrastructure Collaboration.

A Fast Registration Method for MEMS LiDAR Point Cloud Based on Self-Adaptive Segmentation

APR: Online Distant Point Cloud Registration Through Aggregated Point Cloud Reconstruction

Point Cloud Registration Based on Direct Deep Features With Applications in Intelligent Vehicles

Efficient divide-and-conquer registration of UAV and ground LiDAR point clouds through canopy shape context

Coarse-to-fine heterogeneous point clouds registration in vehicle-to-infrastructure collaboration

Point cloud registration for LiDAR and photogrammetric data: A critical synthesis and performance analysis on classic and deep learning algorithms

Enabling Long Range Point Cloud Registration in Vehicular Networks Via Muti-hop Relays

A fast coarse-to-fine point cloud registration based on optical flow for autonomous vehicles

Sparse Point Cloud Registration Network with Semantic Supervision in Wilderness Scenes

Registration of Laser Scanning Point Clouds: A Review

Fast and Robust Registration of Aerial Images and LiDAR data Based on Structrual Features and 3D Phase Correlation

A fast point cloud registration method based on spatial relations and features

A Simple and Efficient Registration of 3D Point Cloud and Image Data for Indoor Mobile Mapping System