Abstract:Compared with traditional manned airborne photogrammetry, unmanned aerial vehicle remote sensing (UAVRS) has the advantages of lower cost and higher flexibility in data acquisition. It has, therefore, found various applications in fields such as three-dimensional (3D) mapping, emergency management, and so on. However, due to the instability of the UAVRS platforms and the low accuracy of the onboard exterior orientation (EO) observations, the use of direct georeferencing image data leads to large location errors. Light detection and ranging (LiDAR) data, which is highly accurate 3D information, is treated as a complementary data source to the optical images. This paper presents a semi-automatic approach for the registration of UAVRS images and airborne LiDAR data based on linear control features. The presented approach consists of three main components, as follows. (1) Buildings are first separated from the point cloud by the integrated use of height and size filtering and RANdom SAmple Consensus (RANSAC) plane fitting, and the 3D line segments of the building ridges and boundaries are semi-automatically extracted through plane intersection and boundary regularization with manual selections; (2) the 3D line segments are projected to the image space using the initial EO parameters to obtain the approximate locations, and all the corresponding 2D line segments are semi-automatically extracted from the UAVRS images. Meanwhile, the tie points of the UAVRS images are generated using a Forstner operator and least-squares image matching; and (3) by use of the equations derived from the coplanarity constraints of the linear control features and the colinear constraints of the tie points, block bundle adjustment is carried out to update the EO parameters of the UAVRS images in the coordinate framework of the LiDAR data, achieving the co-registration of the two datasets. Experiments were performed to demonstrate the validity and effectiveness of the presented method, and a comparison with the traditional registration method based on LiDAR intensity images showed that the presented method is more accurate, and a sub-pixel accuracy level can be achieved.

Remote Sensing Image Registration of Unmanned Aerial Vehicle for Marine Applications

Image Processing Techniques for UAV Vision-Based River Floating Contaminant Detection

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

An Image Segmentation Method Based on Transformer and Multi-Scale Feature Fusion for UAV Marine Environment Monitoring

A Linear Feature-Based Approach For The Registration Of Unmanned Aerial Vehicle Remotely-Sensed Images And Airborne Lidar Data

Infrared and Visible Image Registration in UAV Inspection

A NEW METHOD OF FAST REGISTRATION OF UNMANNED AERIAL VEHICLE REMOTE SENSING IMAGES BASED-ON AN IMPROVED SURF ALGORITHM

Unmanned Aerial Vehicle Oblique Image Registration Using an ASIFT-based Matching Method

A Remote Sensing Imagery Automatic Feature Registration Method Based on Mean-Shift.

Remote Sensing Image Registration Using Multiple Image Features

A Real-Time Registration Algorithm of UAV Aerial Images Based on Feature Matching

Research on Remote Sensing Image Matching with Special Texture Background

Underwater Images Real-Time Registration Method Based on SURF

Image Registration and Fusion of Visible and Infrared Integrated Camera for Medium-Altitude Unmanned Aerial Vehicle Remote Sensing.

Three-Step Registration and Multi-Thread Processing Based Image Mosaic for Unmanned Aerial Vehicle Applications

Underwater Image Mosaic Algorithm Based on Improved Image Registration

Non-Steady State Image Registration of UAV NearInfrared Spectrum Based on MSERS and SURF Algorithm

A Fast and Fully Automatic Registration Approach Based on Point Features for Multi-Source Remote-Sensing Images

A Small UAV Based Multi-Temporal Image Registration for Dynamic Agricultural Terrace Monitoring

Enhancing Georeferencing and Mosaicking Techniques over Water Surfaces with High-Resolution Unmanned Aerial Vehicle (UAV) Imagery

A Robust Multisource Image Automatic Registration System Based on the Sift Descriptor