Abstract:Visual geo-localization enables the UAV to know its position in GNSS-denied application scenarios, such as disaster emergency response, forest inventory management and indoor facility monitoring. However, there are still some challenges in using oblique-view imagery, especially for UAV images with large oblique viewing angles, to perform visual geo-localization. On the one hand, using geotags of references as image-level geo-localization results is insufficient for oblique-view imagery, because the UAV is often situated at a distance and not directly over the observation area. On the other hand, the obvious differences in viewpoint, viewing angle, and scale between UAV oblique-view images and geo-tagged orthographic reference images severely limit the accuracy of all three steps in pixel-level geo-localization, including image-based retrieval, matching and space resection. In this study, we proposed a coarse-to-fine visual geo-localization method to address these challenges for UAV position determination using oblique-view imagery, assisted by orthographic references. Firstly, we proposed a novel image-level geo-localization method by employing Segments Direction Statistics (SDS) feature patterns and bilateral retrieval strategy. Secondly, we matched UAV oblique-view images with geo-tagged orthographic reference images using feature points and descriptors extracted by the improved SuperPoint network, incorporating the Discrete Gaussian Pyramid Module (DGPM) and the Two-stage Matching Results Refinement Module (TMRRM). Thirdly, based on the matched points with 2D pixel coordinates and 3D ground coordinates, we adopted the triangular pyramid constrained resection method with angle similarity constraints to accurately determine the pixel-level position of UAV. We conducted experiments using a publicly available multi-view images dataset (University-1652), as well as two self-collected datasets of oblique-view images captured by UAVs. Experiments indicate that the localization error of the proposed method is less than 0.1 m for applications with the flight height about 200 m. Meanwhile, the error is about 10 m for UAVs with extremely high flight height (more than 4 km) and large oblique viewing angle (more than 60°). And the average time cost of the proposed method is about 400 ms. Therefore, experimental results demonstrated the effectiveness and efficiency of the proposed method in automatically obtaining reliable UAV positions using oblique-view imagery, as well as its robustness for various UAV oblique-view image-based applications.

High-Precision Direct Geolocation Based on Estimation of View Vector Error

Study on Improving GPS Measurement Accuracy

A Robust Position Estimation Algorithm for Low-Cost INS/GPS Integrated Navigation System

A Method Based on the Orbital Error Correction of the Wide Area Differential Positioning Algorithm

Geometric Accuracy Improvement Method for High-Resolution Optical Satellite Remote Sensing Imagery Combining Multi-Temporal SAR Imagery and GLAS Data

High Precision Vehicle Localization Based on Tightly-coupled Visual Odometry and Vector HD Map

A Semantic Vector Map-Based Approach for Aircraft Positioning in GNSS/GPS Denied Large-Scale Environment

An Improved Long-Period Precise Time-Relative Positioning Method Based on RTS Data

Point positioning the geocenter through LEO GPS tracking and its application in geophysics

Accuracy Research on GPS Point Positioning Using IGS Data Products

A coarse-to-fine visual geo-localization method for GNSS-denied UAV with oblique-view imagery

A Novel GNSS Quality Control Method With Satellite Geometric Network for Dynamic Urban Positioning

Three-dimensional positioning on image point of interest via google geographic information

SPS: Accurate and Real-Time Semantic Positioning System Based on Low-Cost DEM Maps

High precision geometric correction based on DEM data and GCP outlier detection for MODIS data

High Precision Location Estimation in Mountainous Areas Using GPS

Improving Target Geolocation Accuracy with Multi-View Aerial Images in Long-Range Oblique Photography

Ionosphere-Weighted Network Real-Time Kinematic Server-Side Approach Combined with Single-Differenced Observations of GPS, GAL, and BDS

New Geo-Location Approach Based on Camera Coordinates and Common Points on Multiple Images

Error of 1: 10000 vector data for land use based on SPOT5 image

A 2D Georeferenced Map Aided Visual-Inertial System for Precise UAV Localization