Abstract:Visual place recognition is a fundamental component in autonomous systems and robotics, which is easily limited in the real world with different viewpoints and changes in appearance. Existing approaches to tackle this problem mainly rely on dominant CNN-based architectures, which are difficult to model global correlation. Most recently, there has emerged little work that focuses on the effectiveness of the Transformer in modeling long-range dependencies, but this strategy ignores local interactions thus fails to localize the really important regions. To address the above issue, this paper proposes an effective Transformer-based architecture that takes full advantages of the strengths of Transformer related to global context modeling and local specific region capturing. We first design a dual-level Transformer descriptor encoder to successively perform self-attention within local windows and global extent of the CNN feature map to obtain multi-scale spatial context, which combines local interaction and global information. Specifically, multi-layer classification tokens from the Transformer encoder are integrated to form the global image representation. Moreover, a Transformer-guided geometric verification module is introduced to leverage the strengths of the hierarchical Transformer’s inherent self-attention mechanism for fusing multi-level attention, which is employed to filter the output token to obtain key patches and associated attention weights for achieving spatial matching. Finally, we propose a descriptor refinement strategy that employs fine-grained region-level supervisions to further enhance the capability of the network to learn local discriminative features, which effectively alleviates the confusion caused from weak image-level labels. Extensive experiments on benchmark datasets show that our approach outperforms state-of-the-art methods with promising performance.

Attention-Guided Spatial Transformer Networks for Fine-Grained Visual Recognition

Spatial-Temporal Attention Network for Open-Set Fine-Grained Image Recognition

Part-Guided Relational Transformers for Fine-Grained Visual Recognition

Multistage attention region supplement transformer for fine-grained visual categorization

A free lunch from ViT:Adaptive Attention Multi-scale Fusion Transformer for Fine-grained Visual Recognition

Dual-Dependency Attention Transformer for Fine-Grained Visual Classification

AA-Trans: Core Attention Aggregating Transformer with Information Entropy Selector for Fine-grained Visual Classification

Hybrid CNN-Transformer Features for Visual Place Recognition

An Attention Model Based on Spatial Transformers for Scene Recognition

A Transformer Architecture with Adaptive Attention for Fine-Grained Visual Classification

RAMS-Trans: Recurrent Attention Multi-scale Transformer forFine-grained Image Recognition

Transformer-based Descriptors with Fine-Grained Region Supervisions for Visual Place Recognition

TransVPR: Transformer-based Place Recognition with Multi-Level Attention Aggregation

Attention Embedded Spatio-Temporal Network for Video Salient Object Detection

Fusion of regional and sparse attention in Vision Transformers

TransFG: A Transformer Architecture for Fine-Grained Recognition

A FREE LUNCH FROM VIT: ADAPTIVE ATTENTION MULTI-SCALE FUSION TRANSFORMER FOR FINE-GRAINED VISUAL RECOGNITION

Learning Cross-Attention Discriminators via Alternating Time–Space Transformers for Visual Tracking

Feature‐enhanced representation with transformers for multi‐view stereo