Abstract:Visual place recognition is a fundamental component in autonomous systems and robotics, which is easily limited in the real world with different viewpoints and changes in appearance. Existing approaches to tackle this problem mainly rely on dominant CNN-based architectures, which are difficult to model global correlation. Most recently, there has emerged little work that focuses on the effectiveness of the Transformer in modeling long-range dependencies, but this strategy ignores local interactions thus fails to localize the really important regions. To address the above issue, this paper proposes an effective Transformer-based architecture that takes full advantages of the strengths of Transformer related to global context modeling and local specific region capturing. We first design a dual-level Transformer descriptor encoder to successively perform self-attention within local windows and global extent of the CNN feature map to obtain multi-scale spatial context, which combines local interaction and global information. Specifically, multi-layer classification tokens from the Transformer encoder are integrated to form the global image representation. Moreover, a Transformer-guided geometric verification module is introduced to leverage the strengths of the hierarchical Transformer’s inherent self-attention mechanism for fusing multi-level attention, which is employed to filter the output token to obtain key patches and associated attention weights for achieving spatial matching. Finally, we propose a descriptor refinement strategy that employs fine-grained region-level supervisions to further enhance the capability of the network to learn local discriminative features, which effectively alleviates the confusion caused from weak image-level labels. Extensive experiments on benchmark datasets show that our approach outperforms state-of-the-art methods with promising performance.

A Coarse-to-Fine Place Recognition Approach using Attention-guided Descriptors and Overlap Estimation

SSC: Semantic Scan Context for Large-Scale Place Recognition

Towards A Deep Insight into Landmark-based Visual Place Recognition: Methodology and Practice.

BEVGM: A Visual Place Recognition Method with Bird's Eye View Graph Matching

BEVPlace: Learning LiDAR-based Place Recognition using Bird's Eye View Images

Fast Sequence-Matching Enhanced Viewpoint-Invariant 3-D Place Recognition.

A fast LiDAR place recognition and localization method by fusing local and global search

A Robust Place Recognition Algorithm Based on Omnidirectional Vision for Mobile Robots.

CMM: LiDAR-Visual Fusion with Cross-Modality Module for Large-Scale Place Recognition

LGD: A fast place recognition method based on the fusion of local and global descriptors

A Novel Approach to Image-Sequence-Based Mobile Robot Place Recognition

Local Descriptor for Robust Place Recognition using LiDAR Intensity

A Faster, Lighter and Stronger Deep Learning-Based Approach for Place Recognition.

ModaLink: Unifying Modalities for Efficient Image-to-PointCloud Place Recognition

Transformer-based Descriptors with Fine-Grained Region Supervisions for Visual Place Recognition

An Efficient Point Cloud Place Recognition Approach Based on Transformer in Dynamic Environment

A New Horizon: Employing Map Clustering Similarity for LiDAR-based Place Recognition

Fast and Consistent Matching for Landmark-Based Place Recognition

CRPlace: Camera-Radar Fusion with BEV Representation for Place Recognition

MambaPlace:Text-to-Point-Cloud Cross-Modal Place Recognition with Attention Mamba Mechanisms

Place Recognition Based on Latent Dirichlet Allocation