Abstract:Long-term visual place recognition is a crucial task for mobile robots. However, it poses significant challenges due to factors such as seasonal changes and variations in illumination, making it difficult to acquire reliable visual features. To address this issue, researchers have proposed leveraging robust features, including semantic and depth information, and integrating them into global descriptors. Unfortunately, existing algorithms primarily concentrate on semantic and depth information, disregarding the relationship between semantic and depth information, as well as the dataset's continuity. In this paper, we employ Generative Adversarial Networks equipped with two discriminators to extract robust features through domain adaptation, effectively utilizing high-quality semantic and depth maps from the Virtual dataset. These features encompass not only semantic and depth information but also coupled semantic-depth information, which plays a vital role in long-term visual place recognition. Furthermore, considering the dataset's continuity, this paper introduces a sequence loss to further enhance the accuracy of visual place recognition, which can be applied to other algorithms. The effectiveness of the proposed method is validated under different appearances, seasons, and illumination conditions. The results demonstrate that, compared to using semantic and depth information alone, our method achieves 2.2%, 1%, and 0.6% in the low-precision metrics for park, suburban, and urban, respectively, on the Extended Carnegie Mellon University (CMU) dataset. When incorporating the proposed sequence loss, our method surpasses state-of-the-art domain adaptation algorithms for retrieval-based visual place recognition.

Domain-Invariant Similarity Activation Map Contrastive Learning for Retrieval-Based Long-Term Visual Localization

Domain-invariant Similarity Activation Map Metric Learning for Retrieval-based Long-term Visual Localization.

Persistent Stereo Visual Localization on Cross-Modal Invariant Map

Long-Term Map-Based Visual Localization: Analysis of Individual Components of a Hierarchical Pipeline

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Communication Constrained Cloud-Based Long-Term Visual Localization in Real Time.

Laser Map Aided Visual Inertial Localization in Changing Environment.

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

Visual Localizer: Outdoor Localization Based on ConvNet Descriptor and Global Optimization for Visually Impaired Pedestrians

2-Entity RANSAC for Robust Visual Localization in Changing Environment

Visual-Inertial Localization And Map Summarization Based On Prior Map

Retrieval-Based Localization Based On Domain-Invariant Feature Learning Under Changing Environments

DASGIL: Domain Adaptation for Semantic and Geometric-Aware Image-Based Localization.

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Learning Visual Semantic Map-Matching for Loosely Multi-Sensor Fusion Localization of Autonomous Vehicles

Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image

Learning a Robust Hybrid Descriptor for Robot Visual Localization

Monocular Visual Place Recognition in LiDAR Maps via Cross-Modal State Space Model and Multi-View Matching

Cross-Modal Monocular Localization in Prior LiDAR Maps Utilizing Semantic Consistency.

CVLNet: Cross-View Semantic Correspondence Learning for Video-based Camera Localization

Learning robust representation and sequence constraint for retrieval-based long-term visual place recognition