Abstract:Visual place recognition (VPR) aims to determine the general geographical location of a query image by retrieving visually similar images from a large geo-tagged database. To obtain a global representation for each place image, most approaches typically focus on the aggregation of deep features extracted from a backbone through using current prominent architectures (e.g., CNNs, MLPs, pooling layer and transformer encoder), giving little attention to the transformer decoder. However, we argue that its strong capability in capturing contextual dependencies and generating accurate features holds considerable potential for the VPR task. To this end, we propose an Efficient Decoder Transformer (EDTformer) for feature aggregation, which consists of several stacked simplified decoder blocks followed by two linear layers to directly generate robust and discriminative global representations for VPR. Specifically, we do this by formulating deep features as the keys and values, as well as a set of independent learnable parameters as the queries. EDTformer can fully utilize the contextual information within deep features, then gradually decode and aggregate the effective features into the learnable queries to form the final global representations. Moreover, to provide powerful deep features for EDTformer and further facilitate the robustness, we use the foundation model DINOv2 as the backbone and propose a Low-Rank Parallel Adaptation (LoPA) method to enhance it, which can refine the intermediate features of the backbone progressively in a memory- and parameter-efficient way. As a result, our method not only outperforms single-stage VPR methods on multiple benchmark datasets, but also outperforms two-stage VPR methods which add a re-ranking with considerable cost. Code will be available at <a class="link-external link-https" href="https://github.com/Tong-Jin01/EDTformer" rel="external noopener nofollow">this https URL</a>.

STA-VPR: Spatio-temporal Alignment for Visual Place Recognition

BEV^2PR: BEV-Enhanced Visual Place Recognition with Structural Cues

Dynamic Time Warping of Deep Features for Place Recognition in Visually Varying Conditions

Visual Place Recognition Based on Multilevel Descriptors for the Visually Impaired People

Self-Supervised Visual Place Recognition by Mining Temporal and Feature Neighborhoods

Self-Supervised Place Recognition by Refining Temporal and Featural Pseudo Labels from Panoramic Data

Deep Homography Estimation for Visual Place Recognition

Enhancing Visual Place Recognition Using Discrete Cosine Transform and Difference-Based Descriptors

Learning Sequence Descriptor based on Spatio-Temporal Attention for Visual Place Recognition

Towards Seamless Adaptation of Pre-trained Models for Visual Place Recognition

AANet: Aggregation and Alignment Network with Semi-hard Positive Sample Mining for Hierarchical Place Recognition

Event-VPR: End-to-End Weakly Supervised Network Architecture for Event-based Visual Place Recognition

CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognition

Salient-VPR: Salient Weighted Global Descriptor for Visual Place Recognition

A Novel Image Descriptor with Aggregated Semantic Skeleton Representation for Long-term Visual Place Recognition

Hybrid CNN-Transformer Features for Visual Place Recognition

EDTformer: An Efficient Decoder Transformer for Visual Place Recognition

MVC-VPR: Mutual Learning of Viewpoint Classification and Visual Place Recognition

TCL: Tightly Coupled Learning Strategy for Weakly Supervised Hierarchical Place Recognition

Visual Place Recognition for Opposite Viewpoints and Environment Changes