Abstract:Co-registration of aerial imagery and Light Detection and Ranging (LiDAR) data is quite challenging because the different imaging mechanisms produce significant geometric and radiometric distortions between the two multimodal data sources. To address this problem, we propose a robust and effective coarse-to-fine registration method that is conducted in two stages utilizing spatial constraints and Gabor structural features. In the first stage, the LiDAR point cloud data is transformed into an intensity map that is used as the reference image. Then, coarse registration is completed by designing a partition-based Features from Accelerated Segment Test (FAST) operator to extract the uniformly distributed interest points in the aerial images and thereafter performing a local geometric correction based on the collinearity equations using the exterior orientation parameters (EoPs). The coarse registration aims to provide a reliable spatial geometry relationship for the subsequent fine registration and is designed to eliminate rotation and scale changes, as well as making only a few translation differences exist between the images. In the second stage, a novel feature descriptor called multi-Scale and multi-Directional Features of odd Gabor (SDFG) is first built to capture the multi-scale and multi-directional structural properties of the images. Then, the three-dimensional (3D) phase correlation (PC) of the SDFG descriptor is established to detect the control points (CPs) between the aerial and LiDAR intensity image in the frequency domain, where the image matching is accelerated by the 3D Fast Fourier Transform (FFT) technique. Finally, the obtained CPs not only are employed to refine the EoPs, but also are used to achieve the fine registration of the aerial images and LiDAR data. We conduct experiments to verify the robustness of the proposed registration method using three sets of aerial images and LiDAR data with different scene coverage. Experimental results show that the proposed method is robust to geometric distortions and radiometric changes. Moreover, it achieves the registration accuracy of less than 2 pixels for all cases, which outperforms the current four state-of-the-art methods, demonstrating its superior registration performance.

Optical Registration Analysis of Multi-Spectral Airborne Camera with Multi-Lens

A Method Of Autofocus For Remote Sensing Camera

Infrared and Visible Image Registration in UAV Inspection

Block-based Multispectral Image Registration with Application to Spectral Color Measurement

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

Optical Image and SAR Image Registration Based on Position Constraint

Image stitching for Airborne Staring LIDAR by vertical range-gated registration

A Method of Image Registration for UAV-borne Compact Multispectral Imager

Study on Multi-Views Point Clouds Registration

Optical and SAR Image Registration Based on Multi-Scale Orientated Map of Phase Congruency

Registration of optical imagery and LiDAR data using an inherent geometrical constraint.

A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration.

A Fast and Robust Matching System for Multimodal Remote Sensing Image Registration

Review of Multi-source Remote Sensing Image Registration Techniques

Robust Registration of Aerial Images and LiDAR Data Using Spatial Constraints and Gabor Structural Features

Remote Sensing Image Registration Based on Multi-Head Self-Attention Mechanism

Optical flow and feature constrains algorithm for remote sensing image registration

A New Fast Multi-Source Remote Sensing Image Registration Algorithm

Robust Registration for Ultra-Field Infrared and Visible Binocular Images

Registration of Panoramic/Fish-Eye Image Sequence and LiDAR Points Using Skyline Features

Multi-sensor Image Registration Using Multi-Resolution Shape Analysis