Abstract:Cross-view geo-localization (CVGL) involves determining the geographical location of a query image by matching it with a corresponding GPS-tagged reference image. Current state-of-the-art methods predominantly rely on training models with labeled paired images, incurring substantial annotation costs and training burdens. In this study, we investigate the adaptation of frozen models for CVGL without requiring ground-truth pair labels. We observe that training on unlabeled cross-view images presents significant challenges, including establishing relationships within unlabeled data and reconciling view discrepancies between uncertain queries and references. To address these challenges, we propose a self-supervised learning framework to train a learnable adapter for a frozen foundation model (FM). This adapter is designed to map feature distributions from diverse views into a uniform space using unlabeled data exclusively. To establish relationships within unlabeled data, we introduce an expectation-maximization (EM)-based pseudolabeling module, which iteratively estimates matching between cross-view features and optimizes the adapter. To maintain the robustness of the FM's representation, we incorporate an information consistency module with a reconstruction loss, ensuring that adapted features retain strong discriminative ability across views. Experimental results demonstrate that our proposed method achieves significant improvements over vanilla FMs and competitive accuracy compared to supervised methods while necessitating fewer training parameters and relying solely on unlabeled data. Evaluation of our adaptation for task-specific models further highlights its broad applicability. Particularly, on the University-1652 dataset, our method outperforms the FM baseline by a substantial margin, achieving about 39 points improvement in Recall@1 and more than 34 points increase in average precision (AP). The project is available at https://collebt.github.io/EM-CVGL.

Cross-Attention Network for Cross-View Image Geo-Localization

A Cross-View Geo-Localization Method Guided by Relation-Aware Global Attention

SSA-Net: Spatial Scale Attention Network for Image-Based Geo-Localization

Cross-View Object Geo-Localization in a Local Region with Satellite Imagery.

Cross-View Geo-Localization with Street-View and VHR Satellite Imagery in Decentrality Settings

Where am I looking at? Joint Location and Orientation Estimation by Cross-View Matching

ConGeo: Robust Cross-view Geo-localization across Ground View Variations

A Satellite-Drone Image Cross-View Geolocalization Method Based on Multi-Scale Information and Dual-Channel Attention Mechanism

SMDT: Cross-View Geo-Localization with Image Alignment and Transformer

Atten-ganCV: an End-to-End Close-Coupled Image-Generating Cross-View Network

Learning Cross-View Visual Geo-Localization Without Ground Truth

IML-Net: A Framework for Cross-View Geo-Localization with Multi-Domain Remote Sensing Data

BEV-CV: Birds-Eye-View Transform for Cross-View Geo-Localisation

A Novel Geo-Localization Method for UAV and Satellite Images Using Cross-View Consistent Attention

Cross-view Geo-localization with Evolving Transformer

Hybrid Perspective Mapping: Align Method for Cross-View Image-Based Geo-Localization

Transformer-Guided Convolutional Neural Network for Cross-View Geolocalization

Simple, Effective and General: A New Backbone for Cross-view Image Geo-localization

Multi-Level Embedding and Alignment Network with Consistency and Invariance Learning for Cross-View Geo-Localization

Cross-View Image Translation Based on Local and Global Information Guidance

A Cross-View Geo-Localization Algorithm Using UAV Image and Satellite Image