Abstract:<p>Accurate registration of light detection and ranging (LiDAR) point clouds and images is a prerequisite for integrating the spectral and geometrical information collected by low-cost unmanned aerial vehicle (UAV) systems. Most registration approaches take the directly georeferenced LiDAR point cloud as a rigid body, based on the assumption that the high-precision positioning and orientation system (POS) in the LiDAR system provides sufficient precision, and that the POS errors are negligible. However, due to the large errors of the low-precision POSs commonly used in the low-cost UAV LiDAR systems (ULSs), dramatic deformation may exist in the directly georeferenced ULS point cloud, resulting in non-rigid transformation between the images and the deformed ULS point cloud. As a result, registration may fail when using a rigid transformation between the images and the directly georeferenced LiDAR point clouds. To address this problem, we proposed NRLI-UAV, which is a non-rigid registration method for registration of sequential raw laser scans and images collected by low-cost UAV systems. NRLI-UAV is a two-step registration method that exploits trajectory correction and discrepancy minimization between the depths derived from structure from motion (SfM) and the raw laser scans to achieve LiDAR point cloud quality improvement. Firstly, the coarse registration procedure utilizes global navigation satellite system (GNSS) and inertial measurement unit (IMU)-aided SfM to obtain accurate image orientation and corrects the errors of the low-precision POS. Secondly, the fine registration procedure transforms the original 2D-3D registration to 3D-3D registration. This is performed by setting the oriented images as the reference, and iteratively minimizing the discrepancy between the depth maps derived from SfM and the raw laser scans, resulting in accurate registration between the images and the LiDAR point clouds. In addition, an improved LiDAR point cloud is generated in the mapping frame. Experiments were conducted with data collected by a low-cost UAV system in three challenging scenes to evaluate NRLI-UAV. The final registration errors of the images and the LiDAR point cloud are less than one pixel in image space and less than 0.13 m in object space. The LiDAR point cloud quality was also evaluated by plane fitting, and the results show that the LiDAR point cloud quality is improved by 8.8 times from 0.45 m (root-mean-square error [RMSE] of plane fitting) to 0.05 m (RMSE of plane fitting) using NRLI-UAV, demonstrating a high level of automation, robustness, and accuracy.</p>

Registration of Optical Images with Lidar Data and Its Accuracy Assessment

Automatic Registration of Terrestrial Laser Scanning Data Using Precisely Located Artificial Planar Targets.

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Registration of optical imagery and LiDAR data using an inherent geometrical constraint.

A Two-step Displacement Correction Algorithm for Registration of Lidar Point Clouds and Aerial Images without Orientation Parameters

A Simple and Efficient Registration of 3D Point Cloud and Image Data for Indoor Mobile Mapping System

An Automatic Registration Approach to Laser Point Sets Based on Multidiscriminant Parameter Extraction

Registration of Laser Scanning Point Clouds: A Review

A Stepwise Minimum Spanning Tree Matching Method for Registering Vehicle-Borne and Backpack LiDAR Point Clouds

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

Registration of Large Optical and SAR Images with Non-Flat Terrain by Investigating Reliable Sparse Correspondences

Point cloud registration for LiDAR and photogrammetric data: A critical synthesis and performance analysis on classic and deep learning algorithms

A high-accuracy multi-temporal laser point cloud registration method for providing a detailed expression of the urban environment

ACCURATE REGISTRATION OF AERIAL IMAGES AND ALS-POINTCLOUD VIA AUTOMATED JUNCTION MATCHING AND PLANAR CONSTRAINTS

Semi-Automatic Registration Of Airborne And Terrestrial Laser Scanning Data Using Building Corner Matching With Boundaries As Reliability Check

Fast and Robust Registration of Aerial Images and LiDAR data Based on Structrual Features and 3D Phase Correlation

Registration of Urban Aerial Image and LiDAR Based on Line Vectors

Hierarchical Registration Method For Airborne And Vehicle Lidar Point Cloud

NRLI-UAV: Non-rigid registration of sequential raw laser scans and images for low-cost UAV LiDAR point cloud quality improvement

Automatic Registration Method of Multi-Source Point Clouds Based on Building Facades Matching in Urban Scenes

Registration‐based point cloud deskewing and dynamic lidar simulation