Abstract:Compared with traditional manned airborne photogrammetry, unmanned aerial vehicle remote sensing (UAVRS) has the advantages of lower cost and higher flexibility in data acquisition. It has, therefore, found various applications in fields such as three-dimensional (3D) mapping, emergency management, and so on. However, due to the instability of the UAVRS platforms and the low accuracy of the onboard exterior orientation (EO) observations, the use of direct georeferencing image data leads to large location errors. Light detection and ranging (LiDAR) data, which is highly accurate 3D information, is treated as a complementary data source to the optical images. This paper presents a semi-automatic approach for the registration of UAVRS images and airborne LiDAR data based on linear control features. The presented approach consists of three main components, as follows. (1) Buildings are first separated from the point cloud by the integrated use of height and size filtering and RANdom SAmple Consensus (RANSAC) plane fitting, and the 3D line segments of the building ridges and boundaries are semi-automatically extracted through plane intersection and boundary regularization with manual selections; (2) the 3D line segments are projected to the image space using the initial EO parameters to obtain the approximate locations, and all the corresponding 2D line segments are semi-automatically extracted from the UAVRS images. Meanwhile, the tie points of the UAVRS images are generated using a Forstner operator and least-squares image matching; and (3) by use of the equations derived from the coplanarity constraints of the linear control features and the colinear constraints of the tie points, block bundle adjustment is carried out to update the EO parameters of the UAVRS images in the coordinate framework of the LiDAR data, achieving the co-registration of the two datasets. Experiments were performed to demonstrate the validity and effectiveness of the presented method, and a comparison with the traditional registration method based on LiDAR intensity images showed that the presented method is more accurate, and a sub-pixel accuracy level can be achieved.

Accurate Registration of Multitemporal UAV Images Based on Detection of Major Changes.

Rotation-Invariant Siamese Network for Low-Altitude Remote-Sensing Image Registration

A Multitemporal UAV Images Registration Approach Using Phase Congruency

Infrared and Visible Image Registration in UAV Inspection

A Real-Time Registration Algorithm of UAV Aerial Images Based on Feature Matching

Fast Automatic Registration of UAV Images via Bidirectional Matching

A Linear Feature-Based Approach For The Registration Of Unmanned Aerial Vehicle Remotely-Sensed Images And Airborne Lidar Data

A Cross-Modal Registration Method for Visible and Infrared Images of Small UAV Targets

A Robust Registration Method for UAV Thermal Infrared and Visible Images Taken by Dual-Cameras

UAV Remote Sensing Image Automatic Registration Based on Deep Residual Features

Unmanned Aerial Vehicle Oblique Image Registration Using an ASIFT-based Matching Method

Investigation and Evaluation of Algorithms for Unmanned Aerial Vehicle Multispectral Image Registration

Automatic Registration of Low Altitude UAV Sequent Images and Laser Point Clouds

Multi-temporal SAR Images Change Detection Considering Ambiguous Co-registration Errors: A Unified Framework

Three-Step Registration and Multi-Thread Processing Based Image Mosaic for Unmanned Aerial Vehicle Applications

A Fast and Fully Automatic Registration Approach Based on Point Features for Multi-Source Remote-Sensing Images

Small UAV based multi-viewpoint image registration for monitoring cultivated land changes in mountainous terrain

Mismatches Removal in Unmanned Aerial Vehicle Image Registration Using Density Based Method

A Robust Transform Estimator Based on Residual Analysis and Its Application on UAV Aerial Images.

Image Registration and Fusion of Visible and Infrared Integrated Camera for Medium-Altitude Unmanned Aerial Vehicle Remote Sensing.

Police UAV image registration based on improved ORB algorithm