Abstract:Aerial vehicles (AVs) commonly operate in vast environments, presenting a persistent challenge in achieving high-precision localization. The contemporary popular global positioning methods have their inherent limitations. For instance, the precision of GPS is susceptible to decline or even complete failure when the signal is disrupted or absent. Furthermore, the precision of image retrieval techniques is inadequate. The construction of 3-D models is a time-consuming and storage-intensive endeavor. In addition, scene coordinate regression necessitates retraining to adapt to varying scenarios, which presents challenges when attempting to generalize across expansive environments. Addressing these challenges, we propose a network named AirGeoNet, which integrates satellite images and semantic maps to achieve high-precision efficient localization. In the first phase, we introduce the foundation model DINOV2 to extract features from satellite and aerial images, employ a vector of locally aggregated descriptor (VLAD) for image retrieval to get coarse position, and, finally, significantly enhance retrieval accuracy by combining sequential images with particle filters. Subsequently, AirGeoNet matches aerial images with semantic maps to determine the three degrees of freedom in pose, including position and orientation. The semantic maps utilized by AirGeoNet are sourced from OpenStreetMap and our self-produced QMap, and training is conducted in a supervised manner using real camera poses. Our AirGeoNet method is highly efficient, requiring only a 1546-D feature vector per image for image retrieval and 240k storage for a 0.9- km(2) semantic map while achieving state-of-the-art accuracy with single-frame localization errors of 2.854 m on semantically rich datasets and 11 m in complex scenarios. Our code is publicly available at https://github.com/mxz520mxz/AirGeoNet.git

AGL-NET: Aerial-Ground Cross-Modal Global Localization with Varying Scales

Geo-Localization with Transformer-Based 2D-3D Match Network

LocNet: Global Localization in 3D Point Clouds for Mobile Vehicles

3D LiDAR-Based Global Localization Using Siamese Neural Network

Collaborative Localization of Aerial and Ground Mobile Robots Through Orthomosaic Map

Global to Local: A Scale-Aware Network for Remote Sensing Object Detection.

AirGeoNet: A Map-guided Visual Geo-Localization Approach for Aerial Vehicles

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

GCG-Net: Graph Classification Geolocation Network.

GLSNet++: Global and Local-Stream Feature Fusion for LiDAR Point Cloud Semantic Segmentation Using GNN Demixing Block

Global Localization in Large-scale Point Clouds via Roll-pitch-yaw Invariant Place Recognition and Low-overlap Global Registration

Visual Landmark Learning Via Attention-Based Deep Neural Networks.

CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Data

Real-time LIDAR localization in natural and urban environments

Road-Network-Based Fast Geolocalization

Multi-Level Embedding and Alignment Network with Consistency and Invariance Learning for Cross-View Geo-Localization

NEGL: Lightweight and Efficient Neighborhood Encoding-Based Global Localization for Unmanned Ground Vehicles

Localization in Aerial Imagery with Grid Maps using LocGAN

GSV-NET: A Multi-Modal Deep Learning Network for 3D Point Cloud Classification

EnforceNet: Monocular Camera Localization in Large Scale Indoor Sparse LiDAR Point Cloud