Abstract:The precise positioning issue of oblique aerial image has been widely studied in recent years. However, there are still some deficiencies in applying the existing methods to highly time-sensitive engineering. For the real-time positioning issues of oblique images involved in Unmanned Aerial Vehicle's (UAV's) patrolling applications, existing photogrammetry method cannot meet the real-time positioning requirements, existing binocular vision method cannot meet the dynamic and precise positioning requirements, existing optical flow method cannot meet the absolute positioning requirements, and existing multi-source feature matching method cannot meet the robust positioning requirements. In order to meet the real-time, dynamic, precise, absolute and robust positioning requirements of UAV's patrolling images, a real-time positioning model for UAV's patrolling images based on airborne LiDAR point cloud fusion is proposed. First , a precise Digital Surface Model (DSM) is generated by rasterizing and imaging the raw airborne LiDAR point cloud, in which a pixel's grayscale is exactly equal to elevation of local area covered by the pixel. Second , the generated DSM and UAV's patrolling image are fused under specific geometric constrains, so as to realize real-time positioning of UAV's patrolling image pixel by pixel. Finally , more precise positioning of selected key points on UAV's patrolling image can be realized by performing Principal Component Analysis (PCA)on the raw airborne LiDAR point cloud that surrounds the selected key points. The above methods are analyzed and verified by three groups of practical experiments, and results indicate that the proposed model can achieve real-time positioning of a single UAV's patrolling image (4000 × 6000 pixels) with an accuracy of 0.5 m within 0.38 seconds in arbitrary areas, and can further realize precise positioning of any selected key point on UAV's patrolling image with an accuracy of 0.2 m in 0.001 seconds.

Adaptive Multi-Image Direct Georeferencing for Unmanned Aerial Vehicle Application

Geo-Registration Of Aerial Images By Feature Matching

Comprehensive Direct Georeferencing of Aerial Images for Unmanned Aerial Systems Applications

A Visual Compass Based on Point and Line Features for UAV High-Altitude Orientation Estimation

Geolocalization from Aerial Sensing Images Using Road Network Alignment

A Real-Time Registration Algorithm of UAV Aerial Images Based on Feature Matching

Multi-Source Image Matching Algorithms for UAV Positioning: Benchmarking, Innovation, and Combined Strategies

Real-time Geo-localization Using Satellite Imagery and Topography for Unmanned Aerial Vehicles

Real-Time Cross-View Image Matching and Camera Pose Determination for Unmanned Aerial Vehicles

Deep Learning-Based UAV Aerial Triangulation without Image Control Points

The development of an UAV borne direct georeferenced photogrammetric platform for Ground Control Point free applications

Infrared and Visible Image Registration in UAV Inspection

Leveraging Map Retrieval and Alignment for Robust UAV Visual Geo-Localization

UAV aerotriangulation with flight-control data support

Enhancing the Localization Accuracy of UAV Images under GNSS Denial Conditions

Direct Georeferencing for the Images in an Airborne LiDAR System by Automatic Boresight Misalignments Calibration

New Geo-Location Approach Based on Camera Coordinates and Common Points on Multiple Images

Fast Automatic Registration of UAV Images via Bidirectional Matching

A Real-time Positioning Model for UAV's Patrolling Images Based on Airborne LiDAR Point Cloud Fusion

An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS

Autonomous Mobile Ground Control Point Improves Accuracy of Agricultural Remote Sensing through Collaboration with UAV