Abstract:Co-registration of aerial imagery and Light Detection and Ranging (LiDAR) data is quite challenging because the different imaging mechanisms produce significant geometric and radiometric distortions between the two multimodal data sources. To address this problem, we propose a robust and effective coarse-to-fine registration method that is conducted in two stages utilizing spatial constraints and Gabor structural features. In the first stage, the LiDAR point cloud data is transformed into an intensity map that is used as the reference image. Then, coarse registration is completed by designing a partition-based Features from Accelerated Segment Test (FAST) operator to extract the uniformly distributed interest points in the aerial images and thereafter performing a local geometric correction based on the collinearity equations using the exterior orientation parameters (EoPs). The coarse registration aims to provide a reliable spatial geometry relationship for the subsequent fine registration and is designed to eliminate rotation and scale changes, as well as making only a few translation differences exist between the images. In the second stage, a novel feature descriptor called multi-Scale and multi-Directional Features of odd Gabor (SDFG) is first built to capture the multi-scale and multi-directional structural properties of the images. Then, the three-dimensional (3D) phase correlation (PC) of the SDFG descriptor is established to detect the control points (CPs) between the aerial and LiDAR intensity image in the frequency domain, where the image matching is accelerated by the 3D Fast Fourier Transform (FFT) technique. Finally, the obtained CPs not only are employed to refine the EoPs, but also are used to achieve the fine registration of the aerial images and LiDAR data. We conduct experiments to verify the robustness of the proposed registration method using three sets of aerial images and LiDAR data with different scene coverage. Experimental results show that the proposed method is robust to geometric distortions and radiometric changes. Moreover, it achieves the registration accuracy of less than 2 pixels for all cases, which outperforms the current four state-of-the-art methods, demonstrating its superior registration performance.

A method to align POS data and linear push-broom imaging data

A Linear Feature-Based Approach For The Registration Of Unmanned Aerial Vehicle Remotely-Sensed Images And Airborne Lidar Data

Geometric Correction of PHI Image Without Control Point

Combined Geometric Positioning and Performance Analysis of Multi-Resolution Optical Imageries from Satellite and Aerial Platforms Based on Weighted RFM Bundle Adjustment

An Anti-Disturbance High-Precision Alignment for Distributed Pos Based on Inertial Reference Frame

A Transfer Alignment Method for Airborne Distributed POS with Three-Dimensional Aircraft Flexure Angles.

Geometric Correction of Phi Hyperspectral Image Without Ground Control Points

Positioning of Airborne Stereo Sar Images with Pos Data and One Gcp

Direct Georeferencing for the Images in an Airborne LiDAR System by Automatic Boresight Misalignments Calibration

Research on the Layout of Ground Control Points in Plain Area 1:10000 DLG Production Using POS Technique

A Robust Ground‐to‐Image Transformation Algorithm and Its Applications in the Geometric Processing of Linear Pushbroom Images

Application of Pos in Correcting Images of Aero-Digital Camera with Large Format Array Ccd

Robust Registration of Aerial Images and LiDAR Data Using Spatial Constraints and Gabor Structural Features

Line-of-sight Locating algorithm for staring imaging aerial remote sensor

Geometric Correction of OMIS Image Based on POS Data

A 3D imaging method for flexible array SAR based on a distributed POS

An Ortho-Rectification Algorithm Based on Collinearity Equation and Polynomial Error Modification for Remote Sensing Imagery

A Two-Step Rectification Algorithm for Airborne Linear Images with POS Data

ACCURATE REGISTRATION OF AERIAL IMAGES AND ALS-POINTCLOUD VIA AUTOMATED JUNCTION MATCHING AND PLANAR CONSTRAINTS

An Incremental LIDAR/POS Online Calibration Method

Positioning Objects From Large Oblique Ultralong Focal Length UAV Imagery