Abstract:Co-registration of aerial imagery and Light Detection and Ranging (LiDAR) data is quite challenging because the different imaging mechanisms produce significant geometric and radiometric distortions between the two multimodal data sources. To address this problem, we propose a robust and effective coarse-to-fine registration method that is conducted in two stages utilizing spatial constraints and Gabor structural features. In the first stage, the LiDAR point cloud data is transformed into an intensity map that is used as the reference image. Then, coarse registration is completed by designing a partition-based Features from Accelerated Segment Test (FAST) operator to extract the uniformly distributed interest points in the aerial images and thereafter performing a local geometric correction based on the collinearity equations using the exterior orientation parameters (EoPs). The coarse registration aims to provide a reliable spatial geometry relationship for the subsequent fine registration and is designed to eliminate rotation and scale changes, as well as making only a few translation differences exist between the images. In the second stage, a novel feature descriptor called multi-Scale and multi-Directional Features of odd Gabor (SDFG) is first built to capture the multi-scale and multi-directional structural properties of the images. Then, the three-dimensional (3D) phase correlation (PC) of the SDFG descriptor is established to detect the control points (CPs) between the aerial and LiDAR intensity image in the frequency domain, where the image matching is accelerated by the 3D Fast Fourier Transform (FFT) technique. Finally, the obtained CPs not only are employed to refine the EoPs, but also are used to achieve the fine registration of the aerial images and LiDAR data. We conduct experiments to verify the robustness of the proposed registration method using three sets of aerial images and LiDAR data with different scene coverage. Experimental results show that the proposed method is robust to geometric distortions and radiometric changes. Moreover, it achieves the registration accuracy of less than 2 pixels for all cases, which outperforms the current four state-of-the-art methods, demonstrating its superior registration performance.

Non-parametric Image Registration of Airborne LiDAR, Hyperspectral and Photographic Imagery of Forests

Unaligned Hyperspectral Image Fusion Via Registration and Interpolation Modeling

Remote Sensing Image Registration Using SIFT and Vegetation Index Analysis

Improving Measurement of Forest Structural Parameters by Co-Registering of High Resolution Aerial Imagery and Low Density LiDAR Data

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

Infrared and Visible Image Registration in UAV Inspection

Multi-spectral Registration Fusion Based on Laser Point Cloud

Automated Structural-level Alignment of Multi-view TLS and ALS Point Clouds in Forestry

A Novel Framework to Automatically Fuse Multiplatform LiDAR Data in Forest Environments Based on Tree Locations

Remote Sensing Image Registration Using Multiple Image Features

Automatic image registration by local descriptors in remote sensing

Registration of Large Optical and SAR Images with Non-Flat Terrain by Investigating Reliable Sparse Correspondences

Advances and Challenges in Multimodal Remote Sensing Image Registration

Efficient divide-and-conquer registration of UAV and ground LiDAR point clouds through canopy shape context

Robust Registration of Aerial Images and LiDAR Data Using Spatial Constraints and Gabor Structural Features

Multi-sensor Image Registration Using Multi-Resolution Shape Analysis

A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration.

A Deep Learning Framework for Remote Sensing Image Registration

Photo Ecometrics for Forest Inventory.

Combining LiDAR Metrics and Sentinel-2 Imagery to Estimate Basal Area and Wood Volume in Complex Forest Environment via Neural Networks

Robust Scan Registration for Navigation in Forest Environment Using Low-Resolution LiDAR Sensors